Sep 27 11:06:31 devstack cinder-volume[76417]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76417) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 27 11:06:31 devstack cinder-volume[76417]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76417) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 27 11:06:31 devstack cinder-volume[76417]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76417) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 27 11:06:32 devstack cinder-volume[76417]: INFO dbcounter [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Registered counter for database cinder
Sep 27 11:06:32 devstack cinder-volume[76417]: DEBUG oslo_db.sqlalchemy.engines [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 27 11:06:33 devstack cinder-volume[76417]: DEBUG dbcounter [-] [76417] Writer thread running {{(pid=76417) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 27 11:06:33 devstack cinder-volume[76417]: INFO cinder.rpc [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 27 11:06:33 devstack cinder-volume[76417]: INFO cinder.rpc [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 27 11:06:33 devstack cinder-volume[76417]: DEBUG oslo_db.sqlalchemy.engines [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 27 11:06:33 devstack cinder-volume[76417]: INFO cinder.volume.manager [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Determined volume DB was empty at startup.
Sep 27 11:06:33 devstack cinder-volume[76417]: DEBUG cinder.volume.manager [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76417) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 27 11:06:33 devstack cinder-volume[76417]: INFO cinder.volume.manager [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 27 11:06:33 devstack cinder-volume[76417]: WARNING stevedore.named [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 27 11:06:33 devstack cinder-volume[76417]: WARNING castellan.key_manager [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 27 11:06:33 devstack cinder-volume[76417]: WARNING cinder.keymgr.conf_key_mgr [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 27 11:06:33 devstack cinder-volume[76417]: DEBUG cinder.volume.drivers.lvm [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76417) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 27 11:06:33 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:34 devstack cinder-volume[76417]: DEBUG oslo_concurrency.processutils [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] CMD "cinder-rtstool verify" returned: 0 in 1.043s {{(pid=76417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:34 devstack cinder-volume[76417]: DEBUG oslo_db.sqlalchemy.engines [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 27 11:06:34 devstack cinder-volume[76417]: INFO cinder.rpc [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 27 11:06:34 devstack cinder-volume[76417]: INFO cinder.rpc [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 27 11:06:34 devstack cinder-volume[76417]: WARNING stevedore.named [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 27 11:06:34 devstack cinder-volume[76417]: WARNING castellan.key_manager [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 27 11:06:34 devstack cinder-volume[76417]: INFO cinder.volume.manager [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 27 11:06:34 devstack cinder-volume[76417]: DEBUG oslo_db.sqlalchemy.engines [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 27 11:06:35 devstack cinder-volume[76417]: INFO oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Starting 1 workers
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Started child 76517 {{(pid=76417) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Full set of CONF: {{(pid=76417) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] ******************************************************************************** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Configuration options gathered from: {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] ================================================================================ {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] allow_availability_zone_fallback = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] allow_compression_on_image_upload = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] allowed_direct_url_schemes     = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] api_rate_limit                 = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] auth_strategy                  = keystone {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] az_cache_duration              = 3600 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_availability_zone      = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_host                   = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_name                   = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_stats_polling_interval = 60 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backup_api_class               = cinder.backup.api.API {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backup_name_template           = backup-%s {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backup_use_same_host           = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backup_use_temp_snapshot       = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] chap_password                  = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] chap_username                  =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76517]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cinder_internal_tenant_project_id = 387a3718e59640c29d465fccfd5c19c0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cinder_internal_tenant_user_id = 47870b2a17ad4235acd53fae03d8b16c {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cloned_volume_same_az          = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cluster                        = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] compression_format             = gzip {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] config_dir                     = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] config_source                  = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] control_exchange               = openstack {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] debug                          = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] default_availability_zone      = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] default_group_type             = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] default_volume_type            = lvmdriver-1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] driver_client_cert             = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] driver_client_cert_key         = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] driver_data_namespace          = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] driver_ssl_cert_path           = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] driver_ssl_cert_verify         = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] driver_use_ssl                 = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] enable_force_upload            = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] enable_new_services            = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] enable_unsupported_driver      = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] enforce_multipath_for_image_xfer = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] filter_function                = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_api_insecure            = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_api_servers             = ['http://192.168.122.135/image'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_api_ssl_compression     = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_ca_certificates_file    = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_certfile                = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_keyfile                 = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_num_retries             = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance_request_timeout         = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] goodness_function              = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] graceful_shutdown_timeout      = 5 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] group_api_class                = cinder.group.api.API {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] host                           = devstack {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_compress_on_upload       = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_conversion_address_space_limit = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_conversion_cpu_limit     = 60 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_conversion_disable       = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_upload_use_cinder_backend = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_upload_use_internal_tenant = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_volume_cache_enabled     = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_volume_cache_max_count   = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] image_volume_cache_max_size_gb = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] init_host_max_objects_retrieval = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] iscsi_iotype                   = fileio {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] iscsi_target_flags             =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] iscsi_write_cache              = on {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] iser_helper                    = tgtadm {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] iser_ip_address                = 192.168.122.135 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] iser_port                      = 3260 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] log_color                      = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] log_config_append              = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] log_dir                        = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] log_file                       = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] log_options                    = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] log_rotate_interval            = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] log_rotate_interval_type       = days {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] log_rotation_type              = none {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] max_age                        = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] max_logfile_count              = 30 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] max_logfile_size_mb            = 200 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] max_over_subscription_ratio    = 20.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] message_reap_interval          = 86400 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] message_ttl                    = 2592000 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] migration_create_volume_timeout_secs = 300 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] monkey_patch                   = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] monkey_patch_modules           = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] my_ip                          = 192.168.122.135 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] no_snapshot_gb_quota           = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] num_iser_scan_tries            = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] num_shell_tries                = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] num_volume_device_scan_tries   = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] nvmeof_conn_info_version       = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] nvmet_ns_id                    = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] nvmet_port_id                  = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] osapi_max_limit                = 1000 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] osapi_volume_ext_list          = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] osapi_volume_listen_port       = 8776 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] osapi_volume_use_ssl           = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] osapi_volume_workers           = 2 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] per_volume_size_limit          = -1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] periodic_fuzzy_delay           = 60 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] periodic_interval              = 60 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] public_endpoint                = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] publish_errors                 = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] quota_backup_gigabytes         = 1000 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] quota_backups                  = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] quota_gigabytes                = 1000 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] quota_groups                   = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] quota_snapshots                = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] quota_volumes                  = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] rate_limit_burst               = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] rate_limit_except_level        = CRITICAL {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] rate_limit_interval            = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] reinit_driver_count            = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] replication_device             = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] report_discard_supported       = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] report_interval                = 120 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] reservation_clean_interval     = 86400 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] reservation_expire             = 86400 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] reserved_image_namespaces      = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] reserved_percentage            = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] rpc_response_timeout           = 120 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] run_external_periodic_tasks    = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] scst_target_driver             = iscsi {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] scst_target_iqn_name           = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_down_time              = 720 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76517]: INFO cinder.volume.manager [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] shell_completion               = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] snapshot_name_template         = snapshot-%s {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] snapshot_same_host             = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] split_loggers                  = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] state_path                     = /opt/stack/data/cinder {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] storage_availability_zone      = nova {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] storage_protocol               = iSCSI {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] syslog_log_facility            = LOG_USER {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] target_helper                  = lioadm {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] target_ip_address              = 192.168.122.135 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] target_port                    = 3260 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] target_protocol                = iscsi {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] target_secondary_ip_addresses  = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] trace_flags                    = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] transport_url                  = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] until_refresh                  = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] use_chap_auth                  = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] use_default_quota_class        = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] use_journal                    = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] use_json                       = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] use_multipath_for_image_xfer   = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] use_stderr                     = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] use_syslog                     = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] verify_glance_signatures       = enabled {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_api_class               = cinder.volume.api.API {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_backend_name            = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_clear                   = zero {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_clear_ionice            = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_clear_size              = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_copy_bps_limit          = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_dd_blocksize            = 1M {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_name_template           = volume-%s {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_service_inithost_offload = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volume_usage_audit_period      = month {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] watch_log_file                 = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] zoning_mode                    = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_concurrency.disable_process_locking = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.admin_password = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.admin_token = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.admin_user  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.auth_port   = 35357 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.auth_protocol = https {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.auth_section = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.auth_type   = password {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.auth_uri    = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.auth_version = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.cache       = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.certfile    = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.identity_uri = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.include_service_catalog = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.insecure    = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.interface   = public {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.keyfile     = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_password =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcache_username =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.region_name = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.service_type = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.backend                  = dogpile.cache.null {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.backend_argument         = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.backend_expiration_time  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.config_prefix            = cache.oslo {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.dead_timeout             = 60.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.debug_cache_backend      = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.enable_retry_client      = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.enable_socket_keepalive  = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.enabled                  = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.enforce_fips_mode        = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.expiration_time          = 600 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.hashclient_retry_attempts = 2 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_dead_retry      = 300 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_password        = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_sasl_enabled    = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.memcache_username        = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.proxies                  = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.redis_db                 = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.redis_password           = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.redis_server             = localhost:6379 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.redis_socket_timeout     = 1.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.redis_username           = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.retry_attempts           = 2 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.retry_delay              = 0.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.socket_keepalive_count   = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.socket_keepalive_idle    = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.socket_keepalive_interval = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.tls_allowed_ciphers      = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.tls_cafile               = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.tls_certfile             = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.tls_enabled              = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cache.tls_keyfile              = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] coordination.backend_url       = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.asyncio_connection    = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.asyncio_slave_connection = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.backend               = sqlalchemy {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.connection            = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.connection_debug      = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.connection_parameters =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.connection_recycle_time = 3600 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.connection_trace      = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.db_inc_retry_interval = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.db_max_retries        = 20 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.db_max_retry_interval = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.db_retry_interval     = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.max_overflow          = 50 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.max_pool_size         = 5 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.max_retries           = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.mysql_wsrep_sync_wait = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.pool_timeout          = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.retry_interval        = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.slave_connection      = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.sqlite_synchronous    = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] database.use_db_reconnect      = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.connection_string     = messaging:// {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.enabled               = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.es_doc_type           = notification {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.es_scroll_size        = 10000 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.es_scroll_time        = 2m {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.filter_error_trace    = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.hmac_keys             = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.sentinel_service_name = mymaster {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.socket_timeout        = 0.1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.trace_requests        = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler.trace_sqlalchemy      = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler_jaeger.process_tags   = {} {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler_jaeger.service_name_prefix = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] profiler_otlp.service_name_prefix = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.enforce_new_defaults = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: WARNING oslo_config.cfg [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.enforce_scope      = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.policy_default_rule = default {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] privsep_osbrick.group          = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] privsep_osbrick.helper_command = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] privsep_osbrick.user           = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cinder_sys_admin.group         = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cinder_sys_admin.helper_command = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] cinder_sys_admin.user          = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.auth_section      = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.auth_type         = password {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.certfile          = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.collect_timing    = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.insecure          = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.keyfile           = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.send_service_user_token = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.split_loggers     = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] service_user.timeout           = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance.auth_section            = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance.auth_type               = password {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance.certfile                = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance.collect_timing          = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance.insecure                = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance.keyfile                 = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance.split_loggers           = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] glance.timeout                 = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.backend_availability_zone = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.chap_password = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.chap_username =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.driver_client_cert = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.driver_client_cert_key = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.driver_data_namespace = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.driver_use_ssl = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.extra_capabilities = {} {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.filter_function = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.goodness_function = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.iscsi_target_flags =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.iscsi_write_cache = on {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.iser_port     = 3260 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.lvm_share_target = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.lvm_type      = auto {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.num_shell_tries = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.replication_device = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.report_discard_supported = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.reserved_percentage = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.target_helper = tgtadm {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.target_port   = 3260 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.target_protocol = iscsi {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.trace_flags   = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.unique_fqdn_network = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.use_chap_auth = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volume_backend_name = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volume_clear  = zero {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volume_clear_ionice = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volume_clear_size = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_reports.file_event_handler = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_reports.log_dir           = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.backend_host       = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.chap_password      = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.chap_username      = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.driver_client_cert = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.extra_capabilities = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.filter_function    = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.goodness_function  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.iser_helper        = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.iser_port          = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.lvm_type           = auto {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.248s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.replication_device = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.report_discard_supported = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.reserved_percentage = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.scst_target_driver = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.storage_protocol   = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.target_ip_address  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.target_port        = 3260 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.trace_flags        = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volume_clear       = zero {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] lvmdriver-1.volumes_dir        = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:35 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_notifications.driver = [] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_notifications.retry = -1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] key_manager.fixed_key          = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.barbican_api_version  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.barbican_endpoint     = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.barbican_endpoint_type = public {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.barbican_region_name  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.cafile                = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.certfile              = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.collect_timing        = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.insecure              = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.keyfile               = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.number_of_retries     = 60 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.retry_delay           = 1 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.send_service_user_token = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.split_loggers         = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.timeout               = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.verify_ssl            = True {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican.verify_ssl_path       = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican_service_user.auth_section = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican_service_user.auth_type = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican_service_user.cafile   = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican_service_user.certfile = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican_service_user.collect_timing = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican_service_user.insecure = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican_service_user.keyfile  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican_service_user.split_loggers = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] barbican_service_user.timeout  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.approle_role_id          = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.approle_secret_id        = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.kv_mountpoint            = secret {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.kv_path                  = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.kv_version               = 2 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.namespace                = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.root_token_id            = **** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.ssl_ca_crt_file          = None {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.timeout                  = 60.0 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.use_ssl                  = False {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:06:36 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] ******************************************************************************** {{(pid=76417) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 27 11:06:36 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.189s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:36 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:36 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.102s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:36 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:36 devstack sudo[76579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 27 11:06:36 devstack sudo[76579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:06:38 devstack sudo[76579]: pam_unix(sudo:session): session closed for user root
Sep 27 11:06:38 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.490s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:38 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:38 devstack sudo[76719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:06:38 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:06:41 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root
Sep 27 11:06:41 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.368s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:41 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:06:41 devstack cinder-volume[76517]: INFO cinder.brick.local_dev.lvm [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 27 11:06:41 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:41 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:41 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:41 devstack sudo[76830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:06:41 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:06:43 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root
Sep 27 11:06:43 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.060s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:43 devstack cinder-volume[76517]: DEBUG cinder.brick.local_dev.lvm [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76517) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 27 11:06:43 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:43 devstack sudo[76928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:06:43 devstack sudo[76928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:06:45 devstack cinder-volume[76417]: DEBUG dbcounter [-] [76417] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76417) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:06:47 devstack sudo[76928]: pam_unix(sudo:session): session closed for user root
Sep 27 11:06:47 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.633s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:47 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:47 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.080s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:47 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:47 devstack sudo[77116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:06:47 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:06:49 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root
Sep 27 11:06:49 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.969s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:49 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:49 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.103s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:49 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:49 devstack sudo[77153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 27 11:06:49 devstack sudo[77153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:06:51 devstack sudo[77153]: pam_unix(sudo:session): session closed for user root
Sep 27 11:06:51 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.010s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:51 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:51 devstack sudo[77173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:06:51 devstack sudo[77173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:06:54 devstack sudo[77173]: pam_unix(sudo:session): session closed for user root
Sep 27 11:06:54 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.933s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:54 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:54 devstack sudo[77248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:06:54 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:06:56 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root
Sep 27 11:06:57 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.663s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:06:57 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:06:57 devstack sudo[77253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:06:57 devstack sudo[77253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:00 devstack sudo[77253]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:00 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.538s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:00 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:00 devstack sudo[77295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:07:00 devstack sudo[77295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:02 devstack sudo[77295]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:02 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.322s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:02 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:03 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.123s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:03 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:03 devstack sudo[77301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:07:03 devstack sudo[77301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:05 devstack sudo[77301]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:05 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.349s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:05 devstack cinder-volume[76517]: INFO cinder.volume.drivers.lvm [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 27 11:07:05 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:05 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.081s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:05 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:05 devstack sudo[77404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:07:05 devstack sudo[77404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:07 devstack sudo[77404]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.939s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:07 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 27 11:07:07 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:07 devstack sudo[77467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:07:07 devstack sudo[77467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:09 devstack sudo[77467]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.936s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:09 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:09 devstack sudo[77563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:07:09 devstack sudo[77563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:12 devstack sudo[77563]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.591s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:12 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:12 devstack sudo[77567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:07:12 devstack sudo[77567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:14 devstack sudo[77567]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:14 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.952s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:14 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:14 devstack sudo[77572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:07:14 devstack sudo[77572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:16 devstack sudo[77572]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:16 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.067s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:16 devstack cinder-volume[76517]: INFO cinder.volume.driver [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Driver hasn't implemented _init_vendor_properties()
Sep 27 11:07:16 devstack cinder-volume[76517]: DEBUG cinder.volume.driver [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76517) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 27 11:07:16 devstack cinder-volume[76517]: DEBUG oslo_db.sqlalchemy.engines [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 27 11:07:16 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writer thread running {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 27 11:07:16 devstack cinder-volume[76517]: DEBUG cinder.db.sqlalchemy.api [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Building query based on filter {{(pid=76517) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 27 11:07:16 devstack cinder-volume[76517]: DEBUG cinder.image.image_utils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76517) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 27 11:07:16 devstack cinder-volume[76517]: INFO cinder.keymgr.migration [None req-2bef03bb-9326-4de6-b414-3133d0a6fd66 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 27 11:07:16 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 27 11:07:16 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:16 devstack sudo[77578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:07:16 devstack sudo[77578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:19 devstack sudo[77578]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:19 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.857s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:19 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:19 devstack sudo[77664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:07:19 devstack sudo[77664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:21 devstack sudo[77664]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:21 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.072s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:21 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:21 devstack sudo[77725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:07:21 devstack sudo[77725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:24 devstack sudo[77725]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:24 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.522s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:24 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:24 devstack sudo[77729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:07:24 devstack sudo[77729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:26 devstack sudo[77729]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:26 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.148s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:26 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:07:26 devstack cinder-volume[76517]: INFO cinder.volume.manager [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Driver initialization completed successfully.
Sep 27 11:07:26 devstack cinder-volume[76517]: INFO cinder.manager [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Initiating service 2 cleanup
Sep 27 11:07:26 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:SELECT=1 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:07:26 devstack cinder-volume[76517]: INFO cinder.manager [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Service 2 cleanup completed.
Sep 27 11:07:26 devstack cinder-volume[76517]: DEBUG cinder.service [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Creating RPC server for service cinder-volume {{(pid=76517) start /opt/stack/cinder/cinder/service.py:239}}
Sep 27 11:07:26 devstack cinder-volume[76517]: DEBUG cinder.service [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76517) start /opt/stack/cinder/cinder/service.py:245}}
Sep 27 11:07:26 devstack cinder-volume[76517]: INFO cinder.volume.manager [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 27 11:07:26 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 27 11:07:26 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:26 devstack sudo[77733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:07:26 devstack sudo[77733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:28 devstack sudo[77733]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:28 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.973s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:28 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:28 devstack sudo[77741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:07:28 devstack sudo[77741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:30 devstack sudo[77741]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:30 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.070s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:30 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:30 devstack sudo[77745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:07:30 devstack sudo[77745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:32 devstack sudo[77745]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:32 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.125s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:33 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:33 devstack sudo[77752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:07:33 devstack sudo[77752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:34 devstack sudo[77752]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:34 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.805s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:34 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:07:35 devstack cinder-volume[76517]: INFO cinder.volume.manager [None req-e37eb1db-1ee4-46f0-9d80-4c1506b6bea8 None None] Driver post RPC initialization completed successfully.
Sep 27 11:07:45 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:UPDATE=1 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:07:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:07:52 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 27 11:07:52 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:52 devstack sudo[78302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:07:52 devstack sudo[78302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:53 devstack sudo[78302]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.814s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:54 devstack sudo[78337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:07:54 devstack sudo[78337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:56 devstack sudo[78337]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:56 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.125s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:56 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:56 devstack sudo[78340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:07:56 devstack sudo[78340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:07:58 devstack sudo[78340]: pam_unix(sudo:session): session closed for user root
Sep 27 11:07:58 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.047s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:07:58 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:07:58 devstack sudo[78343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:07:58 devstack sudo[78343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:08:00 devstack sudo[78343]: pam_unix(sudo:session): session closed for user root
Sep 27 11:08:00 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.061s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:08:00 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:08:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:08:52 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 27 11:08:52 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:08:52 devstack sudo[79142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:08:52 devstack sudo[79142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:08:54 devstack sudo[79142]: pam_unix(sudo:session): session closed for user root
Sep 27 11:08:54 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.944s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:08:54 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:08:54 devstack sudo[79150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:08:54 devstack sudo[79150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:08:55 devstack sudo[79150]: pam_unix(sudo:session): session closed for user root
Sep 27 11:08:55 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.907s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:08:55 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:08:56 devstack sudo[79154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:08:56 devstack sudo[79154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:08:57 devstack sudo[79154]: pam_unix(sudo:session): session closed for user root
Sep 27 11:08:57 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.913s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:08:57 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:08:58 devstack sudo[79162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:08:58 devstack sudo[79162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:08:59 devstack sudo[79162]: pam_unix(sudo:session): session closed for user root
Sep 27 11:08:59 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.804s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:08:59 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:09:45 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:SELECT=1 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:09:45 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:UPDATE=1 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:09:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:09:52 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 27 11:09:52 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:09:52 devstack sudo[80093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:09:52 devstack sudo[80093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:09:54 devstack sudo[80093]: pam_unix(sudo:session): session closed for user root
Sep 27 11:09:54 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.961s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:09:54 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:09:54 devstack sudo[80099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:09:54 devstack sudo[80099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:09:56 devstack sudo[80099]: pam_unix(sudo:session): session closed for user root
Sep 27 11:09:56 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.047s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:09:56 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:09:56 devstack sudo[80128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:09:56 devstack sudo[80128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:09:58 devstack sudo[80128]: pam_unix(sudo:session): session closed for user root
Sep 27 11:09:58 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.972s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:09:58 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:09:58 devstack sudo[80131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:09:58 devstack sudo[80131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:09:59 devstack sudo[80131]: pam_unix(sudo:session): session closed for user root
Sep 27 11:09:59 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.843s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:10:00 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:10:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:10:52 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 27 11:10:52 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:10:52 devstack sudo[82654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:10:52 devstack sudo[82654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:10:53 devstack sudo[82654]: pam_unix(sudo:session): session closed for user root
Sep 27 11:10:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.789s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:10:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:10:53 devstack sudo[82659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:10:53 devstack sudo[82659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:10:55 devstack sudo[82659]: pam_unix(sudo:session): session closed for user root
Sep 27 11:10:55 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.799s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:10:55 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:10:55 devstack sudo[82664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:10:55 devstack sudo[82664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:10:57 devstack sudo[82664]: pam_unix(sudo:session): session closed for user root
Sep 27 11:10:57 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.997s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:10:57 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:10:57 devstack sudo[82671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:10:57 devstack sudo[82671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:10:59 devstack sudo[82671]: pam_unix(sudo:session): session closed for user root
Sep 27 11:10:59 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.898s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:10:59 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:11:45 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:SELECT=1 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:11:45 devstack cinder-volume[76517]: DEBUG dbcounter [-] [76517] Writing DB stats cinder:UPDATE=1 {{(pid=76517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:11:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:11:52 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 27 11:11:52 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:11:52 devstack sudo[82956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:11:52 devstack sudo[82956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:11:53 devstack sudo[82956]: pam_unix(sudo:session): session closed for user root
Sep 27 11:11:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.808s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:11:53 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:11:53 devstack sudo[82965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:11:53 devstack sudo[82965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:11:55 devstack sudo[82965]: pam_unix(sudo:session): session closed for user root
Sep 27 11:11:55 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.732s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:11:55 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:11:55 devstack sudo[82969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:11:55 devstack sudo[82969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:11:57 devstack sudo[82969]: pam_unix(sudo:session): session closed for user root
Sep 27 11:11:57 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.729s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:11:57 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:11:57 devstack sudo[82972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:11:57 devstack sudo[82972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:11:59 devstack sudo[82972]: pam_unix(sudo:session): session closed for user root
Sep 27 11:11:59 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.800s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:11:59 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:12:52 devstack cinder-volume[76517]: DEBUG oslo_service.periodic_task [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:12:52 devstack cinder-volume[76517]: DEBUG cinder.volume.drivers.lvm [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Updating volume stats {{(pid=76517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 27 11:12:52 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:12:52 devstack sudo[83697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 27 11:12:52 devstack sudo[83697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:12:54 devstack sudo[83697]: pam_unix(sudo:session): session closed for user root
Sep 27 11:12:54 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.138s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:12:54 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:12:54 devstack sudo[83731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:12:54 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:12:56 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root
Sep 27 11:12:56 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.430s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:12:56 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:12:56 devstack sudo[83760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 27 11:12:56 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:12:59 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root
Sep 27 11:12:59 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.667s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:12:59 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:12:59 devstack sudo[83810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 27 11:12:59 devstack sudo[83810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:13:02 devstack sudo[83810]: pam_unix(sudo:session): session closed for user root
Sep 27 11:13:02 devstack cinder-volume[76517]: DEBUG oslo_concurrency.processutils [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.714s {{(pid=76517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:13:02 devstack cinder-volume[76517]: DEBUG cinder.manager [None req-b4639bbe-74da-4e44-ac6b-3f0fc22681d1 None None] Notifying Schedulers of capabilities ... {{(pid=76517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:13:06 devstack cinder-volume[76417]: INFO oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Caught SIGTERM, stopping children
Sep 27 11:13:06 devstack cinder-volume[76417]: DEBUG oslo_concurrency.lockutils [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Acquiring lock "singleton_lock" {{(pid=76417) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 27 11:13:06 devstack cinder-volume[76417]: DEBUG oslo_concurrency.lockutils [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Acquired lock "singleton_lock" {{(pid=76417) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 27 11:13:06 devstack cinder-volume[76417]: DEBUG oslo_concurrency.lockutils [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Releasing lock "singleton_lock" {{(pid=76417) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 27 11:13:06 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Stop services. {{(pid=76417) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 27 11:13:06 devstack cinder-volume[76417]: DEBUG oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Killing children. {{(pid=76417) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 27 11:13:06 devstack cinder-volume[76417]: INFO oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Waiting on 1 children to exit
Sep 27 11:13:06 devstack cinder-volume[76517]: DEBUG oslo_concurrency.lockutils [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Acquiring lock "singleton_lock" {{(pid=76517) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 27 11:13:06 devstack cinder-volume[76517]: DEBUG oslo_concurrency.lockutils [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Acquired lock "singleton_lock" {{(pid=76517) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 27 11:13:06 devstack cinder-volume[76517]: DEBUG oslo_concurrency.lockutils [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Releasing lock "singleton_lock" {{(pid=76517) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 27 11:13:06 devstack cinder-volume[76517]: WARNING amqp [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 27 11:13:06 devstack cinder-volume[76517]: WARNING amqp [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 27 11:13:07 devstack cinder-volume[76417]: INFO oslo_service.backend._eventlet.service [None req-9f2408ce-1785-43b4-aa14-2fb0eb6a4bb6 None None] Child 76517 exited with status 0
Sep 27 11:13:23 devstack cinder-volume[83990]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 27 11:13:23 devstack cinder-volume[83990]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 27 11:13:23 devstack cinder-volume[83990]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 27 11:13:27 devstack cinder-volume[83990]: INFO dbcounter [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Registered counter for database cinder
Sep 27 11:13:28 devstack cinder-volume[83990]: DEBUG oslo_db.sqlalchemy.engines [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 27 11:13:28 devstack cinder-volume[83990]: DEBUG dbcounter [-] [83990] Writer thread running {{(pid=83990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 27 11:13:28 devstack cinder-volume[83990]: INFO cinder.rpc [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 27 11:13:28 devstack cinder-volume[83990]: INFO cinder.rpc [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 27 11:13:28 devstack cinder-volume[83990]: DEBUG oslo_db.sqlalchemy.engines [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 27 11:13:29 devstack cinder-volume[83990]: INFO cinder.volume.manager [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Determined volume DB was empty at startup.
Sep 27 11:13:29 devstack cinder-volume[83990]: DEBUG cinder.volume.manager [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83990) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 27 11:13:29 devstack cinder-volume[83990]: INFO cinder.volume.manager [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 27 11:13:29 devstack cinder-volume[83990]: WARNING stevedore.named [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 27 11:13:29 devstack cinder-volume[83990]: WARNING castellan.key_manager [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 27 11:13:29 devstack cinder-volume[83990]: WARNING cinder.keymgr.conf_key_mgr [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 27 11:13:29 devstack cinder-volume[83990]: INFO cinder.volume.manager [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 27 11:13:29 devstack cinder-volume[83990]: DEBUG oslo_db.sqlalchemy.engines [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 27 11:13:29 devstack cinder-volume[83990]: INFO oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Starting 1 workers
Sep 27 11:13:29 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Started child 84197 {{(pid=83990) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Full set of CONF: {{(pid=83990) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] ******************************************************************************** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Configuration options gathered from: {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] ================================================================================ {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] allow_availability_zone_fallback = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] allow_compression_on_image_upload = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] allowed_direct_url_schemes     = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] api_rate_limit                 = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] auth_strategy                  = keystone {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_availability_zone      = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_host                   = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_name                   = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_stats_polling_interval = 60 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backup_api_class               = cinder.backup.api.API {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backup_name_template           = backup-%s {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backup_use_same_host           = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backup_use_temp_snapshot       = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] chap_password                  = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] chap_username                  =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cinder_internal_tenant_project_id = 387a3718e59640c29d465fccfd5c19c0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cinder_internal_tenant_user_id = 47870b2a17ad4235acd53fae03d8b16c {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cluster                        = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] compression_format             = gzip {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] config_dir                     = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] config_source                  = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] control_exchange               = openstack {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] debug                          = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] default_availability_zone      = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] default_group_type             = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] default_volume_type            = QuobyteHD {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] driver_client_cert             = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] driver_client_cert_key         = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] driver_data_namespace          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] driver_ssl_cert_path           = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] driver_ssl_cert_verify         = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] driver_use_ssl                 = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] enable_new_services            = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] enable_unsupported_driver      = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[84197]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] enforce_multipath_for_image_xfer = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] filter_function                = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_api_insecure            = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_api_servers             = ['http://192.168.122.135/image'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_api_ssl_compression     = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_ca_certificates_file    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_certfile                = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_keyfile                 = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_num_retries             = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance_request_timeout         = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] goodness_function              = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] graceful_shutdown_timeout      = 5 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] group_api_class                = cinder.group.api.API {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] host                           = devstack {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_compress_on_upload       = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_conversion_address_space_limit = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_conversion_cpu_limit     = 60 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_conversion_disable       = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_upload_use_cinder_backend = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_upload_use_internal_tenant = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_volume_cache_enabled     = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_volume_cache_max_count   = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] image_volume_cache_max_size_gb = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] init_host_max_objects_retrieval = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] iscsi_iotype                   = fileio {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] iscsi_target_flags             =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] iscsi_write_cache              = on {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] iser_helper                    = tgtadm {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] iser_ip_address                = 192.168.122.135 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] iser_port                      = 3260 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] log_color                      = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] log_config_append              = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] log_dir                        = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] log_file                       = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] log_options                    = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] log_rotate_interval            = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] log_rotate_interval_type       = days {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] log_rotation_type              = none {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] max_age                        = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] max_logfile_count              = 30 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] max_logfile_size_mb            = 200 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] max_over_subscription_ratio    = 20.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] message_reap_interval          = 86400 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] message_ttl                    = 2592000 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] migration_create_volume_timeout_secs = 300 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] monkey_patch                   = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] monkey_patch_modules           = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] my_ip                          = 192.168.122.135 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] no_snapshot_gb_quota           = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] num_iser_scan_tries            = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] num_shell_tries                = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] num_volume_device_scan_tries   = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] nvmeof_conn_info_version       = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] nvmet_ns_id                    = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] nvmet_port_id                  = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] osapi_max_limit                = 1000 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] osapi_volume_ext_list          = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] osapi_volume_listen_port       = 8776 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] osapi_volume_use_ssl           = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] osapi_volume_workers           = 2 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] per_volume_size_limit          = -1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] periodic_fuzzy_delay           = 60 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] periodic_interval              = 60 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] public_endpoint                = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] publish_errors                 = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] quota_backup_gigabytes         = 1000 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] quota_backups                  = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] quota_gigabytes                = 1000 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] quota_groups                   = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] quota_snapshots                = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] quota_volumes                  = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] rate_limit_burst               = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] rate_limit_except_level        = CRITICAL {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] rate_limit_interval            = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] reinit_driver_count            = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] replication_device             = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] report_discard_supported       = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] report_interval                = 120 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] reservation_clean_interval     = 86400 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] reservation_expire             = 86400 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] reserved_image_namespaces      = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] reserved_percentage            = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] rpc_response_timeout           = 120 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] run_external_periodic_tasks    = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] scst_target_driver             = iscsi {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] scst_target_iqn_name           = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_down_time              = 720 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] shell_completion               = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] snapshot_name_template         = snapshot-%s {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] split_loggers                  = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] state_path                     = /opt/stack/data/cinder {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] storage_availability_zone      = nova {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] storage_protocol               = iSCSI {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] syslog_log_facility            = LOG_USER {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] target_helper                  = lioadm {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] target_ip_address              = 192.168.122.135 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] target_port                    = 3260 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] target_protocol                = iscsi {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] target_secondary_ip_addresses  = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] trace_flags                    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] transport_url                  = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] until_refresh                  = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] use_chap_auth                  = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] use_default_quota_class        = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] use_journal                    = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] use_json                       = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] use_multipath_for_image_xfer   = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] use_stderr                     = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] use_syslog                     = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] verify_glance_signatures       = enabled {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_api_class               = cinder.volume.api.API {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_backend_name            = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_clear                   = zero {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_clear_ionice            = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_clear_size              = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_copy_bps_limit          = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_dd_blocksize            = 1M {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_name_template           = volume-%s {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_service_inithost_offload = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volume_usage_audit_period      = month {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] watch_log_file                 = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] zoning_mode                    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_concurrency.disable_process_locking = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.admin_password = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.admin_token = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.admin_user  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.auth_protocol = https {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.auth_section = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.auth_type   = password {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.auth_uri    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.auth_version = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.cache       = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.certfile    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.identity_uri = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.include_service_catalog = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.insecure    = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.interface   = public {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.keyfile     = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_password =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcache_username =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.region_name = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.service_type = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.backend                  = dogpile.cache.null {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.backend_argument         = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.backend_expiration_time  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.config_prefix            = cache.oslo {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.dead_timeout             = 60.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.debug_cache_backend      = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.enable_retry_client      = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.enable_socket_keepalive  = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.enabled                  = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.enforce_fips_mode        = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.expiration_time          = 600 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.hashclient_retry_attempts = 2 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_dead_retry      = 300 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_password        = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_sasl_enabled    = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.memcache_username        = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.proxies                  = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.redis_db                 = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.redis_password           = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.redis_server             = localhost:6379 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.redis_socket_timeout     = 1.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.redis_username           = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.retry_attempts           = 2 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.retry_delay              = 0.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.socket_keepalive_count   = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.socket_keepalive_idle    = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.socket_keepalive_interval = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.tls_allowed_ciphers      = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.tls_cafile               = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.tls_certfile             = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.tls_enabled              = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cache.tls_keyfile              = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] coordination.backend_url       = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.asyncio_connection    = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.asyncio_slave_connection = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.backend               = sqlalchemy {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.connection            = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.connection_debug      = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.connection_parameters =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.connection_recycle_time = 3600 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.connection_trace      = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.db_inc_retry_interval = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.db_max_retries        = 20 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.db_max_retry_interval = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.db_retry_interval     = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.max_overflow          = 50 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.max_pool_size         = 5 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.max_retries           = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.mysql_wsrep_sync_wait = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.pool_timeout          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.retry_interval        = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.slave_connection      = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.sqlite_synchronous    = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] database.use_db_reconnect      = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.connection_string     = messaging:// {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.enabled               = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.es_doc_type           = notification {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.es_scroll_size        = 10000 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.es_scroll_time        = 2m {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.filter_error_trace    = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.hmac_keys             = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.sentinel_service_name = mymaster {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.socket_timeout        = 0.1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.trace_requests        = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler.trace_sqlalchemy      = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler_jaeger.process_tags   = {} {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler_jaeger.service_name_prefix = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] profiler_otlp.service_name_prefix = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.enforce_new_defaults = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:13:30 devstack cinder-volume[83990]: WARNING oslo_config.cfg [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.enforce_scope      = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.policy_default_rule = default {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 27 11:13:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=84197) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] privsep_osbrick.group          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] privsep_osbrick.helper_command = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] privsep_osbrick.user           = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cinder_sys_admin.group         = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cinder_sys_admin.helper_command = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] cinder_sys_admin.user          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.auth_section      = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.auth_type         = password {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.certfile          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.collect_timing    = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.insecure          = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.keyfile           = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.send_service_user_token = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.split_loggers     = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] service_user.timeout           = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance.auth_section            = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance.auth_type               = password {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance.certfile                = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance.collect_timing          = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance.insecure                = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance.keyfile                 = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance.split_loggers           = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] glance.timeout                 = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.backend_availability_zone = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.chap_password = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.chap_username =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.driver_client_cert = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.driver_client_cert_key = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.driver_data_namespace = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.driver_use_ssl = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.extra_capabilities = {} {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.filter_function = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.goodness_function = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.iscsi_target_flags =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.iscsi_write_cache = on {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.iser_port     = 3260 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_host      =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_login     = admin {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_mount_options = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_password  = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_private_key =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_share_path =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.num_shell_tries = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.quobyte_volume_url = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.replication_device = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.report_discard_supported = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.reserved_percentage = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.target_helper = tgtadm {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.target_port   = 3260 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.target_protocol = iscsi {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.trace_flags   = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.unique_fqdn_network = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.use_chap_auth = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.volume_backend_name = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.volume_clear  = zero {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.volume_clear_ionice = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.volume_clear_size = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_reports.file_event_handler = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_reports.log_dir           = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.backend_availability_zone = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.backend_host         = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.chap_password        = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.chap_username        = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.driver_client_cert   = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.driver_data_namespace = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.extra_capabilities   = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.filter_function      = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.goodness_function    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.iscsi_iotype         = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.iser_helper          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.iser_ip_address      = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.iser_port            = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_host             = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_login            = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_mount_options    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_password         = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_private_key      = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_share_path       = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.num_shell_tries      = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.replication_device   = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.report_discard_supported = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.reserved_percentage  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.scst_target_driver   = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.storage_protocol     = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.target_helper        = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.target_ip_address    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.target_port          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.target_prefix        = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.target_protocol      = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.trace_flags          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.use_chap_auth        = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.volume_clear         = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.volume_clear_size    = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] QuobyteHD.volumes_dir          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_notifications.driver = [] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_notifications.retry = -1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] key_manager.fixed_key          = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.barbican_api_version  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.barbican_endpoint     = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.barbican_endpoint_type = public {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.barbican_region_name  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.cafile                = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.certfile              = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.collect_timing        = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.insecure              = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.keyfile               = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.number_of_retries     = 60 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.retry_delay           = 1 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.send_service_user_token = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.split_loggers         = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.timeout               = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.verify_ssl            = True {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican.verify_ssl_path       = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican_service_user.auth_section = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican_service_user.auth_type = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican_service_user.cafile   = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican_service_user.certfile = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican_service_user.collect_timing = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican_service_user.insecure = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican_service_user.keyfile  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican_service_user.split_loggers = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] barbican_service_user.timeout  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.approle_role_id          = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.approle_secret_id        = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.kv_mountpoint            = secret {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.kv_path                  = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.kv_version               = 2 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.namespace                = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.root_token_id            = **** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.ssl_ca_crt_file          = None {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.timeout                  = 60.0 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.use_ssl                  = False {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 27 11:13:30 devstack cinder-volume[83990]: DEBUG oslo_service.backend._eventlet.service [None req-741435f3-6d79-49b0-b9ab-63931bf899d9 None None] ******************************************************************************** {{(pid=83990) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 27 11:13:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=84197) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 27 11:13:30 devstack cinder-volume[84197]: INFO cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 27 11:13:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Running cmd (subprocess): mount.quobyte {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:13:31 devstack quobyte-client[84201]: Reading configuration file: /etc/quobyte/client.cfg
Sep 27 11:13:31 devstack quobyte-client[84201]: Invalid parameters found, error: missing mount point.
Sep 27 11:13:31 devstack quobyte-client[84201]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 27 11:13:31 devstack quobyte-client[84201]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 27 11:13:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] CMD "mount.quobyte" returned: 1 in 0.446s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:13:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:13:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:13:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:13:31 devstack cinder-volume[84197]: INFO cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Mounting volume: 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 ...
Sep 27 11:13:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 -c /etc/quobyte/client-cinder.cfg {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:13:31 devstack quobyte-client[84212]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 27 11:13:31 devstack quobyte-client[84212]: Reading configuration file: /etc/quobyte/client.cfg
Sep 27 11:13:31 devstack quobyte-client[84212]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65' to display the log.
Sep 27 11:13:31 devstack quobyte-client[84221]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 27 11:13:31 devstack quobyte-client[84221]: mount.quobyte 3.25 (4fbbd59204)
Sep 27 11:13:31 devstack quobyte-client[84221]: Client UUID: FVI2iGi8-Bfef-aVa2-witz-j4q1FVD40o8D
Sep 27 11:13:31 devstack quobyte-client[84221]: Registry: osci01.corp.quobyte.com:7861
Sep 27 11:13:31 devstack quobyte-client[84221]: Volume: cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:13:31 devstack quobyte-client[84221]: FUSE version: 316
Sep 27 11:13:31 devstack quobyte-client[84221]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 27 11:13:31 devstack quobyte-client[84221]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 27 11:13:31 devstack quobyte-client[84221]: Setting total object cache size to 3352297472 bytes
Sep 27 11:13:31 devstack quobyte-client[84221]: Using FUSE low-level API
Sep 27 11:13:31 devstack quobyte-client[84221]: Caching of uid/gid to user/group name mappings is enabled
Sep 27 11:13:31 devstack quobyte-client[84221]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 27 11:13:32 devstack quobyte-client[84221]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 27 11:13:32 devstack quobyte-client[84221]: HTTP server started on port 55000
Sep 27 11:13:32 devstack quobyte-client[84221]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 27 11:13:32 devstack quobyte-client[84221]: Mount point /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 established
Sep 27 11:13:32 devstack quobyte-client[84221]: TimeSync is running and remote sync every 60 seconds
Sep 27 11:13:32 devstack quobyte-client[84221]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 27 11:13:32 devstack quobyte-client[84221]: Ignored time synchronization message because time source took too long to respond (61 ms)
Sep 27 11:13:32 devstack quobyte-client[84221]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 27 11:13:32 devstack quobyte-client[84221]: Opening volume cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 (55f6f18d-800b-4611-bcfd-6c008ff589eb)
Sep 27 11:13:32 devstack quobyte-client[84221]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 27 11:13:32 devstack quobyte-client[84221]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 27 11:13:32 devstack quobyte-client[84221]: Changed metadata cache configuration for volume 55f6f18d-800b-4611-bcfd-6c008ff589eb to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false
Sep 27 11:13:32 devstack quobyte-client[84221]: Failed to invalidate inode: 38: Function not implemented
Sep 27 11:13:32 devstack quobyte-client[84221]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 27 11:13:32 devstack quobyte-client[84221]: Automatic minidump upload enabled by global system configuration
Sep 27 11:13:32 devstack quobyte-client[84221]: Announcing HTTP status server address 172.24.4.1
Sep 27 11:13:32 devstack quobyte-client[84221]: Registered as service (uuid FVI2iGi8-Bfef-aVa2-witz-j4q1FVD40o8D)
Sep 27 11:13:32 devstack quobyte-client[84221]: Quobyte Client running as pid 84221
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.933s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:13:32 devstack quobyte-client[84221]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 27 11:13:32 devstack quobyte-client[84221]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 27 11:13:32 devstack cinder-volume[84197]: INFO cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Mounting volume: 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 succeeded
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:13:32 devstack quobyte-client[84221]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.101s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:13:32 devstack cinder-volume[84197]: INFO cinder.volume.driver [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Driver hasn't implemented _init_vendor_properties()
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG cinder.volume.driver [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84197) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG oslo_db.sqlalchemy.engines [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writer thread running {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG cinder.db.sqlalchemy.api [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Building query based on filter {{(pid=84197) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84197) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 27 11:13:32 devstack cinder-volume[84197]: INFO cinder.keymgr.migration [None req-3b7f8fde-708b-49f5-95a7-7eac65db2db3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:13:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.064s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:13:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Driver initialization completed successfully.
Sep 27 11:13:33 devstack cinder-volume[84197]: INFO cinder.manager [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Initiating service 3 cleanup
Sep 27 11:13:33 devstack cinder-volume[84197]: INFO cinder.manager [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Service 3 cleanup completed.
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG cinder.service [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Creating RPC server for service cinder-volume {{(pid=84197) start /opt/stack/cinder/cinder/service.py:239}}
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG cinder.service [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84197) start /opt/stack/cinder/cinder/service.py:245}}
Sep 27 11:13:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 27 11:13:33 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:13:33 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:13:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.122s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:13:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e93b898f-a4fb-4d56-808b-acedb5616540 None None] Driver post RPC initialization completed successfully.
Sep 27 11:13:35 devstack quobyte-client[84221]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 27 11:13:39 devstack cinder-volume[83990]: DEBUG dbcounter [-] [83990] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:13:43 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:13:43 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:14:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:14:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:14:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:14:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:14:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:14:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:14:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:14:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.149s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:14:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:14:47 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:14:47 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Flow 'volume_create_manager' (8e3264e7-c996-4a64-afa8-e67f62c25d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c6117e-37fc-45e1-be98-5bb19e06286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c6117e-37fc-45e1-be98-5bb19e06286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1616124739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a312b492-e957-43a5-82ed-ad8f6db0922a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2d4c29df4f414698da93bc7dc3cb53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:14:47Z,use_quota=True,user_id='bc4e6befd48148a7a97d353862e362a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bdcb30-8123-419e-ab05-a388a9906aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bdcb30-8123-419e-ab05-a388a9906aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d881416-349e-43ff-9493-baa32d1d48e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d881416-349e-43ff-9493-baa32d1d48e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a312b492-e957-43a5-82ed-ad8f6db0922a', 'volume_name': 'volume-a312b492-e957-43a5-82ed-ad8f6db0922a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f4b022-6c0b-4a56-b6f8-8702ea1cc3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f4b022-6c0b-4a56-b6f8-8702ea1cc3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e372ab4-7185-4f31-b8dd-dc52067bb791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:14:48 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Volume a312b492-e957-43a5-82ed-ad8f6db0922a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a312b492-e957-43a5-82ed-ad8f6db0922a', 'volume_size': 1}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1616124739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a312b492-e957-43a5-82ed-ad8f6db0922a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2d4c29df4f414698da93bc7dc3cb53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:14:47Z,use_quota=True,user_id='bc4e6befd48148a7a97d353862e362a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Creating volume a312b492-e957-43a5-82ed-ad8f6db0922a {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:14:48 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:14:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:14:48 devstack quobyte-client[84221]: System call of process 84489 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:14:49 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=2, name=volume-a312b492-e957-43a5-82ed-ad8f6db0922a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:14:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a 1073741824" returned: 0 in 0.932s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:14:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:14:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a" returned: 0 in 0.165s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:14:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] <== create_volume: return (1212ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:14:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:14:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e372ab4-7185-4f31-b8dd-dc52067bb791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a312b492-e957-43a5-82ed-ad8f6db0922a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:14:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc429c83-0921-4099-b90e-c08424165499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:14:50 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Volume volume-a312b492-e957-43a5-82ed-ad8f6db0922a (a312b492-e957-43a5-82ed-ad8f6db0922a): created successfully
Sep 27 11:14:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc429c83-0921-4099-b90e-c08424165499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:14:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Flow 'volume_create_manager' (8e3264e7-c996-4a64-afa8-e67f62c25d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:14:50 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-692b9585-cb29-43aa-8080-cebf101ce647 tempest-VolumesAssistedSnapshotsTest-233350723 None] Created volume successfully.
Sep 27 11:15:00 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:15:00 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:15:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:15:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:15:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:15:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:15:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:15:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:15:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:15:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.297s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:15:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:15:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:15:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:15:50 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:15:50 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:15:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Flow 'volume_create_manager' (70243b73-c9c7-4b7f-bc2a-1c0d5a18e430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:15:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db68942d-0ce8-4e3d-99d3-55d990a1e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db68942d-0ce8-4e3d-99d3-55d990a1e471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1467851552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bd4f50-0443-45fd-b34b-f219a1c38deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803ec32e70e4dc79e3310db5902c5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:15:50Z,use_quota=True,user_id='89e13696be9044ada5f26c7888d042e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ceb0c35-bbf9-4938-9bcd-c9bf94d6b1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ceb0c35-bbf9-4938-9bcd-c9bf94d6b1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738b9a10-90c5-4c7e-b5ff-255118c1565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738b9a10-90c5-4c7e-b5ff-255118c1565c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3bd4f50-0443-45fd-b34b-f219a1c38deb', 'volume_name': 'volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a8cf56-cd99-4b38-bd67-c635cae51d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a8cf56-cd99-4b38-bd67-c635cae51d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9254b37b-7aef-4384-9633-dbc0fcf547f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:15:51 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Volume d3bd4f50-0443-45fd-b34b-f219a1c38deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb', 'volume_size': 1}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1467851552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bd4f50-0443-45fd-b34b-f219a1c38deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1803ec32e70e4dc79e3310db5902c5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:15:50Z,use_quota=True,user_id='89e13696be9044ada5f26c7888d042e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Creating volume d3bd4f50-0443-45fd-b34b-f219a1c38deb {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:15:51 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:15:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:15:52 devstack quobyte-client[84221]: System call of process 85178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:15:52 devstack quobyte-client[84221]: System call of process 85178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:15:52 devstack quobyte-client[84221]: System call of process 85178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:15:52 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=3, name=volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:15:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb 1073741824" returned: 0 in 1.141s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:15:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:15:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb" returned: 0 in 0.345s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:15:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] <== create_volume: return (1628ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:15:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:15:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9254b37b-7aef-4384-9633-dbc0fcf547f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:15:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e41a11-0cae-44a9-a512-003a7e7676d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:15:54 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Volume volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb (d3bd4f50-0443-45fd-b34b-f219a1c38deb): created successfully
Sep 27 11:15:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e41a11-0cae-44a9-a512-003a7e7676d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:15:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Flow 'volume_create_manager' (70243b73-c9c7-4b7f-bc2a-1c0d5a18e430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:15:54 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-92f6c121-ba74-41f4-9361-523eeaf44b34 tempest-VolumesAdminNegativeTest-1368072303 None] Created volume successfully.
Sep 27 11:15:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Acquiring lock "cinder-d3bd4f50-0443-45fd-b34b-f219a1c38deb-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:15:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "cinder-d3bd4f50-0443-45fd-b34b-f219a1c38deb-delete_volume" acquired by "delete_volume" :: waited 0.220s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:15:58 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:15:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Acquiring lock "cinder-quobyte-d3bd4f50-0443-45fd-b34b-f219a1c38deb" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:15:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "cinder-quobyte-d3bd4f50-0443-45fd-b34b-f219a1c38deb" acquired by "delete_volume" :: waited 0.026s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:15:58 devstack cinder-volume[84197]: INFO oslo.privsep.daemon [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzkmqsgl9/privsep.sock']
Sep 27 11:15:58 devstack sudo[85186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzkmqsgl9/privsep.sock
Sep 27 11:15:58 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:16:07 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:16:08 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:16:14 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root
Sep 27 11:16:14 devstack cinder-volume[84197]: INFO oslo.privsep.daemon [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Spawned new privsep daemon via rootwrap
Sep 27 11:16:14 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Accepted privsep connection to /tmp/tmpzkmqsgl9/privsep.sock {{(pid=84197) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 27 11:16:15 devstack cinder-volume[84197]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 27 11:16:15 devstack cinder-volume[84197]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 27 11:16:15 devstack cinder-volume[84197]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 27 11:16:15 devstack cinder-volume[84197]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85239
Sep 27 11:16:15 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a24d719-4206-4c89-aa72-3e84929de178]: (2,) {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:16:15 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3b3ce7-b130-464f-a25b-82383eef5c64]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:16:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:16:16 devstack quobyte-client[84221]: System call of process 85282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:16:16 devstack quobyte-client[84221]: System call of process 85282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:16:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb" returned: 0 in 1.835s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:16:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:16:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3bd4f50-0443-45fd-b34b-f219a1c38deb" returned: 0 in 0.284s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:16:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "cinder-quobyte-d3bd4f50-0443-45fd-b34b-f219a1c38deb" released by "delete_volume" :: held 19.398s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:16:18 devstack cinder-volume[84197]: WARNING cinder.quota [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:16:18 devstack cinder-volume[84197]: WARNING cinder.quota [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:16:18 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Created reservations ['64b18806-b7c6-42a6-b3d8-b5322f1a0089', 'e8258095-45aa-4940-b7ed-aa70add33eda', '96639e51-5b65-4255-a430-03d252d1e87f', '13ce233c-9dee-4867-939d-011f7c3e9202'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:16:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:16:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:16:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:16:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:16:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:16:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:16:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.195s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:16:19 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:16:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Deleted volume successfully.
Sep 27 11:16:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-954d69a7-6415-4f71-83c6-83edc1ba7375 tempest-VolumesAdminNegativeTest-1368072303 None] Lock "cinder-d3bd4f50-0443-45fd-b34b-f219a1c38deb-delete_volume" released by "delete_volume" :: held 22.901s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:16:29 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:16:30 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:16:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:16:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:16:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:16:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:16:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:16:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:16:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:16:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.139s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:16:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:17:15 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:17:15 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:17:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Flow 'volume_create_manager' (f715dd35-d46d-4cb7-ac60-6736a5ff2435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:17:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab02836-d044-49ed-b89f-d83b582443d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab02836-d044-49ed-b89f-d83b582443d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2086736368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8c590e-b587-4c07-bf54-2f743dc8f474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181362147de54190af6bf6da8807a368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:17:15Z,use_quota=True,user_id='66ab339d1d134390b572bfafd995ae38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ba99c4-f9ff-46c7-815d-4477579c5d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ba99c4-f9ff-46c7-815d-4477579c5d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9843d78-411c-4a0d-906a-fa877e809491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9843d78-411c-4a0d-906a-fa877e809491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8c590e-b587-4c07-bf54-2f743dc8f474', 'volume_name': 'volume-0b8c590e-b587-4c07-bf54-2f743dc8f474', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e90229-d053-46fb-8ce1-b0f8e4fdadfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e90229-d053-46fb-8ce1-b0f8e4fdadfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090eb5ac-c1c2-4a4e-b145-9401e0c21c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:16 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Volume 0b8c590e-b587-4c07-bf54-2f743dc8f474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8c590e-b587-4c07-bf54-2f743dc8f474', 'volume_size': 1}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2086736368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8c590e-b587-4c07-bf54-2f743dc8f474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181362147de54190af6bf6da8807a368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:17:15Z,use_quota=True,user_id='66ab339d1d134390b572bfafd995ae38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Creating volume 0b8c590e-b587-4c07-bf54-2f743dc8f474 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:17:16 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:17:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:17:16 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=4, name=volume-0b8c590e-b587-4c07-bf54-2f743dc8f474, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:17:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474 1073741824" returned: 0 in 1.453s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:17:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:17:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474" returned: 0 in 0.347s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:17:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] <== create_volume: return (2072ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:17:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:17:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090eb5ac-c1c2-4a4e-b145-9401e0c21c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8c590e-b587-4c07-bf54-2f743dc8f474', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d2f566-0b14-4cf5-aead-583805853fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:19 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Volume volume-0b8c590e-b587-4c07-bf54-2f743dc8f474 (0b8c590e-b587-4c07-bf54-2f743dc8f474): created successfully
Sep 27 11:17:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d2f566-0b14-4cf5-aead-583805853fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Flow 'volume_create_manager' (f715dd35-d46d-4cb7-ac60-6736a5ff2435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:17:19 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9d176006-4c3a-4327-bae7-bdf2acdc0fed tempest-AttachSCSIVolumeTestJSON-2065966807 None] Created volume successfully.
Sep 27 11:17:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-7a94b965-dbcd-416b-846f-e96030abe482 req-df47820f-6d69-4657-a1de-0de3908cccee tempest-VolumesAssistedSnapshotsTest-233350723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:17:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-7a94b965-dbcd-416b-846f-e96030abe482 req-df47820f-6d69-4657-a1de-0de3908cccee tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:17:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-177c1ef5-6fc2-4860-a00b-936289587d5a req-d4848174-949d-44de-8928-42f504cdcdb2 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:17:28 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[5902536f-04d0-428f-b2a5-ad1e95ef150a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:17:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-7a94b965-dbcd-416b-846f-e96030abe482 req-df47820f-6d69-4657-a1de-0de3908cccee tempest-VolumesAssistedSnapshotsTest-233350723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:17:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-7a94b965-dbcd-416b-846f-e96030abe482 req-df47820f-6d69-4657-a1de-0de3908cccee tempest-VolumesAssistedSnapshotsTest-233350723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a" returned: 0 in 0.400s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:17:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-7a94b965-dbcd-416b-846f-e96030abe482 req-df47820f-6d69-4657-a1de-0de3908cccee tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.474s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:17:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-177c1ef5-6fc2-4860-a00b-936289587d5a req-d4848174-949d-44de-8928-42f504cdcdb2 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.651s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:17:29 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[663eb96b-cd9a-4f72-ab64-7eee56937290]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:17:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-177c1ef5-6fc2-4860-a00b-936289587d5a req-d4848174-949d-44de-8928-42f504cdcdb2 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:17:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-7a94b965-dbcd-416b-846f-e96030abe482 req-df47820f-6d69-4657-a1de-0de3908cccee tempest-VolumesAssistedSnapshotsTest-233350723 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-a312b492-e957-43a5-82ed-ad8f6db0922a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8124c3b0-736a-41e9-8d3f-e261e56079c0', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:17:29 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-7a94b965-dbcd-416b-846f-e96030abe482 req-df47820f-6d69-4657-a1de-0de3908cccee tempest-VolumesAssistedSnapshotsTest-233350723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:17:30 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-7a94b965-dbcd-416b-846f-e96030abe482 req-df47820f-6d69-4657-a1de-0de3908cccee tempest-VolumesAssistedSnapshotsTest-233350723 None] attachment_update completed successfully.
Sep 27 11:17:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-177c1ef5-6fc2-4860-a00b-936289587d5a req-d4848174-949d-44de-8928-42f504cdcdb2 tempest-AttachSCSIVolumeTestJSON-2065966807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474" returned: 0 in 0.586s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:17:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-177c1ef5-6fc2-4860-a00b-936289587d5a req-d4848174-949d-44de-8928-42f504cdcdb2 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.628s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:17:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-177c1ef5-6fc2-4860-a00b-936289587d5a req-d4848174-949d-44de-8928-42f504cdcdb2 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-0b8c590e-b587-4c07-bf54-2f743dc8f474', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58b3b8f4-c4a7-4f64-9a08-a2fde31f8d6a', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:17:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-177c1ef5-6fc2-4860-a00b-936289587d5a req-d4848174-949d-44de-8928-42f504cdcdb2 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:17:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-177c1ef5-6fc2-4860-a00b-936289587d5a req-d4848174-949d-44de-8928-42f504cdcdb2 tempest-AttachSCSIVolumeTestJSON-2065966807 None] attachment_update completed successfully.
Sep 27 11:17:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:17:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:17:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:17:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:17:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:17:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:17:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:17:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.097s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:17:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:17:43 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=11 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:17:43 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:17:54 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Flow 'volume_create_manager' (8c90c6d5-b52b-4f3a-bd88-3bf68f52269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f16583-50a6-4b68-be64-c1ef7a7a0b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f16583-50a6-4b68-be64-c1ef7a7a0b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1945341047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581f0239-5e44-4832-9a36-4f63d35345ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53f36ce4884aa081c56db7aa5b7f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:17:54Z,use_quota=True,user_id='f1af4fc0d0d6434f9ce043ff8cbf07f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ab6b81-c56a-49a8-b7eb-4bdfb3db00d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ab6b81-c56a-49a8-b7eb-4bdfb3db00d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5b0f51-c0a9-450f-97f6-f7de9c8f5f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5b0f51-c0a9-450f-97f6-f7de9c8f5f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '581f0239-5e44-4832-9a36-4f63d35345ea', 'volume_name': 'volume-581f0239-5e44-4832-9a36-4f63d35345ea', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789a029a-c0e2-4590-b6b8-8d20064c82a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789a029a-c0e2-4590-b6b8-8d20064c82a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b415fc-7b4f-4fdd-aaa9-ef02c15d8e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:54 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Volume 581f0239-5e44-4832-9a36-4f63d35345ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-581f0239-5e44-4832-9a36-4f63d35345ea', 'volume_size': 1}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1945341047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581f0239-5e44-4832-9a36-4f63d35345ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53f36ce4884aa081c56db7aa5b7f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:17:54Z,use_quota=True,user_id='f1af4fc0d0d6434f9ce043ff8cbf07f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Creating volume 581f0239-5e44-4832-9a36-4f63d35345ea {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:17:54 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:17:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:17:54 devstack quobyte-client[84221]: System call of process 86155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:17:54 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=5, name=volume-581f0239-5e44-4832-9a36-4f63d35345ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:17:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea 1073741824" returned: 0 in 0.446s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:17:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:17:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea" returned: 0 in 0.112s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:17:55 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] <== create_volume: return (629ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:17:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.646s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:17:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b415fc-7b4f-4fdd-aaa9-ef02c15d8e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-581f0239-5e44-4832-9a36-4f63d35345ea', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28533754-40c9-44c7-9c5d-5fe8956032ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:17:55 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Volume volume-581f0239-5e44-4832-9a36-4f63d35345ea (581f0239-5e44-4832-9a36-4f63d35345ea): created successfully
Sep 27 11:17:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28533754-40c9-44c7-9c5d-5fe8956032ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:17:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Flow 'volume_create_manager' (8c90c6d5-b52b-4f3a-bd88-3bf68f52269c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:17:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-93af72fe-6451-48a4-8bb2-6a28339f8fdb tempest-DeleteServersTestJSON-18468122 None] Created volume successfully.
Sep 27 11:18:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-c318544c-d0df-4400-94f4-344b5164ee50 req-82bdd083-4447-4c19-80ef-aa061c293a85 tempest-DeleteServersTestJSON-18468122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:18:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-c318544c-d0df-4400-94f4-344b5164ee50 req-82bdd083-4447-4c19-80ef-aa061c293a85 tempest-DeleteServersTestJSON-18468122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:18:00 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ffae5e-a37d-406e-8233-55910c7fe7e3]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:18:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-c318544c-d0df-4400-94f4-344b5164ee50 req-82bdd083-4447-4c19-80ef-aa061c293a85 tempest-DeleteServersTestJSON-18468122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-c318544c-d0df-4400-94f4-344b5164ee50 req-82bdd083-4447-4c19-80ef-aa061c293a85 tempest-DeleteServersTestJSON-18468122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea" returned: 0 in 0.429s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-c318544c-d0df-4400-94f4-344b5164ee50 req-82bdd083-4447-4c19-80ef-aa061c293a85 tempest-DeleteServersTestJSON-18468122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.495s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:18:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-c318544c-d0df-4400-94f4-344b5164ee50 req-82bdd083-4447-4c19-80ef-aa061c293a85 tempest-DeleteServersTestJSON-18468122 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-581f0239-5e44-4832-9a36-4f63d35345ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8e68c93-929e-494d-9e32-1a6c321c4cdf', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:18:01 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-c318544c-d0df-4400-94f4-344b5164ee50 req-82bdd083-4447-4c19-80ef-aa061c293a85 tempest-DeleteServersTestJSON-18468122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:01 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-c318544c-d0df-4400-94f4-344b5164ee50 req-82bdd083-4447-4c19-80ef-aa061c293a85 tempest-DeleteServersTestJSON-18468122 None] attachment_update completed successfully.
Sep 27 11:18:04 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-1c4d541a-d635-4cd1-9666-5a7ae3f3e154 req-08b553c7-80c3-493f-be07-ffa15e595294 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:04 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-1c4d541a-d635-4cd1-9666-5a7ae3f3e154 req-08b553c7-80c3-493f-be07-ffa15e595294 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-1c4d541a-d635-4cd1-9666-5a7ae3f3e154 req-08b553c7-80c3-493f-be07-ffa15e595294 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Terminate volume connection completed successfully.
Sep 27 11:18:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-1c4d541a-d635-4cd1-9666-5a7ae3f3e154 req-08b553c7-80c3-493f-be07-ffa15e595294 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Deleting attachment 58b3b8f4-c4a7-4f64-9a08-a2fde31f8d6a. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:18:04 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-58e9a2d8-caed-4876-b755-bdfa41e94568 req-44161ba0-d8d0-4f88-8105-73373a5c66aa tempest-VolumesAssistedSnapshotsTest-233350723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:04 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-58e9a2d8-caed-4876-b755-bdfa41e94568 req-44161ba0-d8d0-4f88-8105-73373a5c66aa tempest-VolumesAssistedSnapshotsTest-233350723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-58e9a2d8-caed-4876-b755-bdfa41e94568 req-44161ba0-d8d0-4f88-8105-73373a5c66aa tempest-VolumesAssistedSnapshotsTest-233350723 None] Terminate volume connection completed successfully.
Sep 27 11:18:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-58e9a2d8-caed-4876-b755-bdfa41e94568 req-44161ba0-d8d0-4f88-8105-73373a5c66aa tempest-VolumesAssistedSnapshotsTest-233350723 None] Deleting attachment 8124c3b0-736a-41e9-8d3f-e261e56079c0. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:18:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Acquiring lock "cinder-a312b492-e957-43a5-82ed-ad8f6db0922a-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:18:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "cinder-a312b492-e957-43a5-82ed-ad8f6db0922a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:18:07 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Acquiring lock "cinder-quobyte-a312b492-e957-43a5-82ed-ad8f6db0922a" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:18:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "cinder-quobyte-a312b492-e957-43a5-82ed-ad8f6db0922a" acquired by "delete_volume" :: waited 0.051s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:18:07 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23e039-9b90-469d-9f67-50e1e4e62233]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:18:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:08 devstack quobyte-client[84221]: System call of process 86186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:18:08 devstack quobyte-client[84221]: System call of process 86186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:18:08 devstack quobyte-client[84221]: System call of process 86186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:18:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a" returned: 0 in 1.024s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a312b492-e957-43a5-82ed-ad8f6db0922a" returned: 0 in 0.589s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "cinder-quobyte-a312b492-e957-43a5-82ed-ad8f6db0922a" released by "delete_volume" :: held 2.236s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:18:11 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Created reservations ['5f19807d-ac6f-4056-9450-ccc42f9a444a', 'f2906ec9-ab58-49eb-bf10-143a3a802fb5', '9de27d28-307c-4439-b032-db86c031f203', '74cb9d73-12da-4a66-b738-2b831d04eaef'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:18:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:18:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:18:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:18:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:18:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:18:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.332s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:12 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:18:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Deleted volume successfully.
Sep 27 11:18:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e327d4d-d0ef-4fa1-82ee-0ac1548ba302 tempest-VolumesAssistedSnapshotsTest-233350723 None] Lock "cinder-a312b492-e957-43a5-82ed-ad8f6db0922a-delete_volume" released by "delete_volume" :: held 5.411s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:18:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-56e7713b-4247-4ddf-b66d-e063c79a8f2b req-0f305306-5ca3-4e32-a4ef-25cb0bc34b96 tempest-DeleteServersTestJSON-18468122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-56e7713b-4247-4ddf-b66d-e063c79a8f2b req-0f305306-5ca3-4e32-a4ef-25cb0bc34b96 tempest-DeleteServersTestJSON-18468122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:14 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-56e7713b-4247-4ddf-b66d-e063c79a8f2b req-0f305306-5ca3-4e32-a4ef-25cb0bc34b96 tempest-DeleteServersTestJSON-18468122 None] Terminate volume connection completed successfully.
Sep 27 11:18:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-56e7713b-4247-4ddf-b66d-e063c79a8f2b req-0f305306-5ca3-4e32-a4ef-25cb0bc34b96 tempest-DeleteServersTestJSON-18468122 None] Deleting attachment a8e68c93-929e-494d-9e32-1a6c321c4cdf. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:18:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Acquiring lock "cinder-581f0239-5e44-4832-9a36-4f63d35345ea-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:18:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Lock "cinder-581f0239-5e44-4832-9a36-4f63d35345ea-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:18:21 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Acquiring lock "cinder-quobyte-581f0239-5e44-4832-9a36-4f63d35345ea" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:18:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Lock "cinder-quobyte-581f0239-5e44-4832-9a36-4f63d35345ea" acquired by "delete_volume" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:18:21 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[612944cf-512d-438a-8988-5164ac025fc5]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:18:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:22 devstack quobyte-client[84221]: System call of process 86388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:18:22 devstack quobyte-client[84221]: System call of process 86388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:18:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea" returned: 0 in 1.011s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-581f0239-5e44-4832-9a36-4f63d35345ea" returned: 0 in 0.141s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Lock "cinder-quobyte-581f0239-5e44-4832-9a36-4f63d35345ea" released by "delete_volume" :: held 1.539s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:18:23 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Created reservations ['33eb4f98-921c-490d-ae7c-0d4e60f5c74e', '8f11b096-b0dc-48a1-8bf7-0216451bda9f', '4e06b81e-d0dd-4d02-bc91-62784d073b52', '486ae73a-5a68-46cc-a7df-4fcbe03e1a70'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:18:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:18:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:18:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:18:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:18:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:18:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.250s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:24 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:18:24 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Deleted volume successfully.
Sep 27 11:18:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b9fa66e2-8680-48a0-ae15-b626a2e47abf tempest-DeleteServersTestJSON-18468122 None] Lock "cinder-581f0239-5e44-4832-9a36-4f63d35345ea-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:18:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Acquiring lock "cinder-0b8c590e-b587-4c07-bf54-2f743dc8f474-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:18:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "cinder-0b8c590e-b587-4c07-bf54-2f743dc8f474-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:18:26 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:18:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Acquiring lock "cinder-quobyte-0b8c590e-b587-4c07-bf54-2f743dc8f474" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:18:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "cinder-quobyte-0b8c590e-b587-4c07-bf54-2f743dc8f474" acquired by "delete_volume" :: waited 0.025s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:18:26 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0f34f7-25cd-47af-95bd-6147ec98cc89]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:18:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:27 devstack quobyte-client[84221]: System call of process 86407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:18:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474" returned: 0 in 0.959s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b8c590e-b587-4c07-bf54-2f743dc8f474" returned: 0 in 0.155s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "cinder-quobyte-0b8c590e-b587-4c07-bf54-2f743dc8f474" released by "delete_volume" :: held 1.345s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Created reservations ['f2ad5443-4f37-47c8-994c-46f01f2153d0', '97940bcb-52d1-4ed7-83cb-f61e52d9ca71', '32b454fa-59ee-4b54-b5c6-c48820108758', 'fec45e1b-54f4-4064-b317-29b898dafdbb'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.128s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:29 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:18:29 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Deleted volume successfully.
Sep 27 11:18:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f23fb230-dd0c-4cae-9443-bc1dfc5be788 tempest-AttachSCSIVolumeTestJSON-2065966807 None] Lock "cinder-0b8c590e-b587-4c07-bf54-2f743dc8f474-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:18:38 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=20,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:18:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:18:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:18:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:18:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:18:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:18:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:18:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:18:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.115s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:18:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:18:39 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=38,cinder:DELETE=3,cinder:SELECT=29,cinder:INSERT=7 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:19:36 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:19:36 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:19:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Flow 'volume_create_manager' (a97b45fb-1581-4417-b721-916abaee7a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de817e58-198e-4323-9c71-cf340863eb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de817e58-198e-4323-9c71-cf340863eb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-709864035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e444b6-43cd-4b85-babf-87b5991eef12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8eed5e31df44b2960b9e9bdd05e57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:37Z,use_quota=True,user_id='34ae01f65ccd4ac698fe22a39aed6463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cc7fa2-8504-4887-89b4-71a681b3b739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cc7fa2-8504-4887-89b4-71a681b3b739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c1bf84-6427-479f-836d-290a4f5e4300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:36 devstack cinder-volume[84197]: DEBUG cinder.image.glance [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Creating Keystone auth plugin from conf {{(pid=84197) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 27 11:19:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c1bf84-6427-479f-836d-290a4f5e4300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81e444b6-43cd-4b85-babf-87b5991eef12', 'volume_name': 'volume-81e444b6-43cd-4b85-babf-87b5991eef12', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d2279a0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f72da94-3317-4ec6-b500-76a55164189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f72da94-3317-4ec6-b500-76a55164189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c665e349-feeb-40de-bb34-8c82e7ed7145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:37 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Volume 81e444b6-43cd-4b85-babf-87b5991eef12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81e444b6-43cd-4b85-babf-87b5991eef12', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d2279a0>}
Sep 27 11:19:37 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Cloning 81e444b6-43cd-4b85-babf-87b5991eef12 from image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3  at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]). {{(pid=84197) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 27 11:19:38 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 27 11:19:38 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Image download 20.69 MB at 20.69 MB/s
Sep 27 11:19:38 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d77a701-28ae-49d2-b65f-b5249fa06976]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:19:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:19:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:19:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:19:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.194s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:19:39 devstack sudo[86497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD
Sep 27 11:19:39 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:19:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Flow 'volume_create_manager' (0be22d2f-87f9-448b-b122-8688acddb03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6234497f-9b3e-4050-a6ab-79f1ef364103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:41 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6234497f-9b3e-4050-a6ab-79f1ef364103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-153466210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6adef5a3-6428-46ac-bc90-2622844fc671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062522e7a1774dd68470d694773e5c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:41Z,use_quota=True,user_id='2c3975b227c64401b0fa293cd5180312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb36437d-230b-4d74-8f38-0e20aea7170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb36437d-230b-4d74-8f38-0e20aea7170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0a9e56-69de-4838-bedb-4c65699f8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0a9e56-69de-4838-bedb-4c65699f8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6adef5a3-6428-46ac-bc90-2622844fc671', 'volume_name': 'volume-6adef5a3-6428-46ac-bc90-2622844fc671', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f84cdfb-6045-402d-8acc-565ba74ccc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f84cdfb-6045-402d-8acc-565ba74ccc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836f8795-f382-4fce-8e72-32e0981d0fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:41 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Volume 6adef5a3-6428-46ac-bc90-2622844fc671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6adef5a3-6428-46ac-bc90-2622844fc671', 'volume_size': 1}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-153466210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6adef5a3-6428-46ac-bc90-2622844fc671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062522e7a1774dd68470d694773e5c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:41Z,use_quota=True,user_id='2c3975b227c64401b0fa293cd5180312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Creating volume 6adef5a3-6428-46ac-bc90-2622844fc671 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:19:41 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:19:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6adef5a3-6428-46ac-bc90-2622844fc671 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD" returned: 0 in 3.369s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:42 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Temporary image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 is fetched for user 34ae01f65ccd4ac698fe22a39aed6463. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 27 11:19:42 devstack quobyte-client[84221]: System call of process 86504 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:42 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=6, name=volume-6adef5a3-6428-46ac-bc90-2622844fc671, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:19:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6adef5a3-6428-46ac-bc90-2622844fc671 1073741824" returned: 0 in 0.843s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6adef5a3-6428-46ac-bc90-2622844fc671 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6adef5a3-6428-46ac-bc90-2622844fc671" returned: 0 in 0.187s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] <== create_volume: return (1075ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:19:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:43 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[6607fafa-d986-4597-aa86-194ef6e32c50]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:19:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836f8795-f382-4fce-8e72-32e0981d0fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6adef5a3-6428-46ac-bc90-2622844fc671', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c16a9e-dd8d-4455-8281-9a8c63b63f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:43 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Volume volume-6adef5a3-6428-46ac-bc90-2622844fc671 (6adef5a3-6428-46ac-bc90-2622844fc671): created successfully
Sep 27 11:19:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c16a9e-dd8d-4455-8281-9a8c63b63f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Flow 'volume_create_manager' (0be22d2f-87f9-448b-b122-8688acddb03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:43 devstack sudo[86508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD
Sep 27 11:19:43 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:19:43 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-130e3cbb-a5e8-433d-8069-48a91c2f9dfc tempest-VolumesServicesTestJSON-1662399758 None] Created volume successfully.
Sep 27 11:19:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Acquiring lock "cinder-6adef5a3-6428-46ac-bc90-2622844fc671-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:19:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Lock "cinder-6adef5a3-6428-46ac-bc90-2622844fc671-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:19:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:19:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Acquiring lock "cinder-quobyte-6adef5a3-6428-46ac-bc90-2622844fc671" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:19:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Lock "cinder-quobyte-6adef5a3-6428-46ac-bc90-2622844fc671" acquired by "delete_volume" :: waited 0.015s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:19:45 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[963a4a3f-e2cf-4b2d-9645-58e120d143b2]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:19:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6adef5a3-6428-46ac-bc90-2622844fc671 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:46 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD" returned: 0 in 2.990s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-709864035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e444b6-43cd-4b85-babf-87b5991eef12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8eed5e31df44b2960b9e9bdd05e57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:37Z,use_quota=True,user_id='34ae01f65ccd4ac698fe22a39aed6463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Creating volume 81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:19:46 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:46 devstack quobyte-client[84221]: System call of process 86514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:46 devstack quobyte-client[84221]: System call of process 86514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:46 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=7, name=volume-81e444b6-43cd-4b85-babf-87b5991eef12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6adef5a3-6428-46ac-bc90-2622844fc671" returned: 0 in 1.046s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6adef5a3-6428-46ac-bc90-2622844fc671 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6adef5a3-6428-46ac-bc90-2622844fc671" returned: 0 in 0.144s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Lock "cinder-quobyte-6adef5a3-6428-46ac-bc90-2622844fc671" released by "delete_volume" :: held 1.502s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 1073741824" returned: 0 in 0.737s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12" returned: 0 in 0.269s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] <== create_volume: return (1058ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Created reservations ['cb16b4af-9f26-4f79-983b-22b7307f68ec', '107b1994-a1e8-41ce-ab7d-637ef41daf89', '18d339b7-d4b5-4bd0-82f0-f9e11d5e9857', 'df2b1ca8-1706-4878-a9fc-1f59f78df79a'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Attempting download of 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}])) to volume 81e444b6-43cd-4b85-babf-87b5991eef12. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fd4a1c-9ab2-42be-a5c5-87afa93dfe43]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_4qjp9_ha {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.172s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:48 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:19:48 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Deleted volume successfully.
Sep 27 11:19:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_4qjp9_ha" returned: 0 in 0.699s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_4qjp9_ha {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae5e0d57-4afe-4dcc-ad3a-a1e2c1052ec4 tempest-VolumesServicesTestJSON-1662399758 None] Lock "cinder-6adef5a3-6428-46ac-bc90-2622844fc671-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:19:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_4qjp9_ha" returned: 1 in 0.525s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_4qjp9_ha' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:19:48 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1995bbb3-6475-416a-ac0c-db215862a1f3]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:19:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:49 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 was qcow2, converting to raw {{(pid=84197) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 27 11:19:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:49 devstack quobyte-client[84221]: System call of process 86530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:49 devstack quobyte-client[84221]: System call of process 86530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:49 devstack quobyte-client[84221]: System call of process 86530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:49 devstack quobyte-client[84221]: System call of process 86530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:49 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=7, name=volume-81e444b6-43cd-4b85-babf-87b5991eef12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:19:49 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:19:49 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Flow 'volume_create_manager' (e28bfc37-9cf2-4917-a85f-e958117cf296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1411f1d5-2119-4209-b583-515d3b6803f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1411f1d5-2119-4209-b583-515d3b6803f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-206323498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9713b7a-f2b3-4147-affc-bf8a7d72d32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3df267837f43aa8644608f7861c233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:49Z,use_quota=True,user_id='6953ac270c444d1195b902d4005f5b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d81a563-e2e3-4826-9b3c-5f1745be224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d81a563-e2e3-4826-9b3c-5f1745be224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbab4c38-2360-49bc-b5f1-0c9c3f208f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbab4c38-2360-49bc-b5f1-0c9c3f208f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9713b7a-f2b3-4147-affc-bf8a7d72d32f', 'volume_name': 'volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99163d95-2f54-4b8d-9bcc-877d0cd8b35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99163d95-2f54-4b8d-9bcc-877d0cd8b35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcea1877-5e2a-45d6-bb06-2f85f7ba3243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:50 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Volume b9713b7a-f2b3-4147-affc-bf8a7d72d32f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f', 'volume_size': 1}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-206323498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9713b7a-f2b3-4147-affc-bf8a7d72d32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3df267837f43aa8644608f7861c233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:49Z,use_quota=True,user_id='6953ac270c444d1195b902d4005f5b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Creating volume b9713b7a-f2b3-4147-affc-bf8a7d72d32f {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:19:50 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:19:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:50 devstack quobyte-client[84221]: System call of process 86538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:50 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=8, name=volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f 1073741824" returned: 0 in 0.675s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12" returned: 0 in 1.664s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_nte5y8h0devstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:19:51 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Converted 112.00 MB image at 65.67 MB/s
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f" returned: 0 in 0.201s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] <== create_volume: return (970ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 1G" returned: 0 in 0.322s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcea1877-5e2a-45d6-bb06-2f85f7ba3243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdbbe80-f8de-4d55-a2de-b6cb1d64e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:51 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Volume volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f (b9713b7a-f2b3-4147-affc-bf8a7d72d32f): created successfully
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdbbe80-f8de-4d55-a2de-b6cb1d64e649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Flow 'volume_create_manager' (e28bfc37-9cf2-4917-a85f-e958117cf296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1aa62f-d8db-4fb6-9d68-4353ca850998]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:19:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:51 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1b6c2c62-8705-4a82-aed6-adb16283d9d1 tempest-TaggedAttachmentsTest-1491326788 None] Created volume successfully.
Sep 27 11:19:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12" returned: 0 in 0.561s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12" returned: 1 in 0.469s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:19:52 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Downloaded image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}])) to volume 81e444b6-43cd-4b85-babf-87b5991eef12 successfully. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 27 11:19:52 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Temporary image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 for user 34ae01f65ccd4ac698fe22a39aed6463 is deleted. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 27 11:19:52 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Marking volume 81e444b6-43cd-4b85-babf-87b5991eef12 as bootable. {{(pid=84197) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 27 11:19:52 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Copying metadata from image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 to 81e444b6-43cd-4b85-babf-87b5991eef12. {{(pid=84197) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 27 11:19:52 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Creating volume glance metadata for volume 81e444b6-43cd-4b85-babf-87b5991eef12 backed by image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84197) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 27 11:19:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c665e349-feeb-40de-bb34-8c82e7ed7145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e444b6-43cd-4b85-babf-87b5991eef12', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d2279a0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb2664a-4cbd-4ae1-8fc5-12e9befcdce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:53 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Volume volume-81e444b6-43cd-4b85-babf-87b5991eef12 (81e444b6-43cd-4b85-babf-87b5991eef12): created successfully
Sep 27 11:19:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb2664a-4cbd-4ae1-8fc5-12e9befcdce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Flow 'volume_create_manager' (a97b45fb-1581-4417-b721-916abaee7a6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:53 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1a57acbe-b886-482e-8303-23bee1684a8d tempest-TaggedBootDevicesTest-26589849 None] Created volume successfully.
Sep 27 11:19:54 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Flow 'volume_create_manager' (f744d7ed-238c-44f4-b9c2-e5686beb201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d298bdbb-67a6-4dfd-ac4d-56db2052f2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d298bdbb-67a6-4dfd-ac4d-56db2052f2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1677129784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8eed5e31df44b2960b9e9bdd05e57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:54Z,use_quota=True,user_id='34ae01f65ccd4ac698fe22a39aed6463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83bc708-ca1a-40ed-a8a2-ed1b78473b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83bc708-ca1a-40ed-a8a2-ed1b78473b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2a0562-d568-4ba5-be7c-915a7d973c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2a0562-d568-4ba5-be7c-915a7d973c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c', 'volume_name': 'volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09918815-a777-48f8-887b-55e3df1892cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09918815-a777-48f8-887b-55e3df1892cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa5579f-db1d-4038-8d9a-a8e3f57d51bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:54 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Volume fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c', 'volume_size': 1}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1677129784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8eed5e31df44b2960b9e9bdd05e57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:54Z,use_quota=True,user_id='34ae01f65ccd4ac698fe22a39aed6463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Creating volume fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:19:54 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:54 devstack quobyte-client[84221]: System call of process 86553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:54 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=9, name=volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c 1073741824" returned: 0 in 0.430s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c" returned: 0 in 0.129s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:55 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] <== create_volume: return (625ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:19:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.640s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa5579f-db1d-4038-8d9a-a8e3f57d51bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431e151a-92f4-4854-a680-1f6ad8f00117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:55 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Volume volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c (fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c): created successfully
Sep 27 11:19:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431e151a-92f4-4854-a680-1f6ad8f00117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Flow 'volume_create_manager' (f744d7ed-238c-44f4-b9c2-e5686beb201b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9e65f815-6142-4e11-8b68-8ac29a9e00bb tempest-TaggedBootDevicesTest-26589849 None] Created volume successfully.
Sep 27 11:19:56 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Flow 'volume_create_manager' (f576e8a7-0bdc-4fe9-8b89-1ec5a1848121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d3aa5a-e1c5-4183-842f-f13c43ac961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d3aa5a-e1c5-4183-842f-f13c43ac961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1594507950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5268557a-e503-4616-94c8-b90bbab02303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8eed5e31df44b2960b9e9bdd05e57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:57Z,use_quota=True,user_id='34ae01f65ccd4ac698fe22a39aed6463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534fff0-cb29-4e55-a35b-670d6c10e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534fff0-cb29-4e55-a35b-670d6c10e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b297268-d6d2-416f-99c6-534c0870c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b297268-d6d2-416f-99c6-534c0870c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5268557a-e503-4616-94c8-b90bbab02303', 'volume_name': 'volume-5268557a-e503-4616-94c8-b90bbab02303', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a9b5e-86cb-4b0e-83ca-0a4c60b8de0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a9b5e-86cb-4b0e-83ca-0a4c60b8de0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca23200-6fa2-4d6a-ae96-00ea3fcbcda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:57 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Volume 5268557a-e503-4616-94c8-b90bbab02303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5268557a-e503-4616-94c8-b90bbab02303', 'volume_size': 1}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1594507950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5268557a-e503-4616-94c8-b90bbab02303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8eed5e31df44b2960b9e9bdd05e57a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:19:57Z,use_quota=True,user_id='34ae01f65ccd4ac698fe22a39aed6463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Creating volume 5268557a-e503-4616-94c8-b90bbab02303 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:19:57 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:57 devstack quobyte-client[84221]: System call of process 86557 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:57 devstack quobyte-client[84221]: System call of process 86557 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:57 devstack quobyte-client[84221]: System call of process 86557 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:57 devstack quobyte-client[84221]: System call of process 86557 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:19:57 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=10, name=volume-5268557a-e503-4616-94c8-b90bbab02303, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303 1073741824" returned: 0 in 0.500s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303" returned: 0 in 0.140s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] <== create_volume: return (732ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:19:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:19:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca23200-6fa2-4d6a-ae96-00ea3fcbcda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5268557a-e503-4616-94c8-b90bbab02303', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8569b1d-fb63-47c7-bea0-0e7388cce280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:19:58 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Volume volume-5268557a-e503-4616-94c8-b90bbab02303 (5268557a-e503-4616-94c8-b90bbab02303): created successfully
Sep 27 11:19:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8569b1d-fb63-47c7-bea0-0e7388cce280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:19:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Flow 'volume_create_manager' (f576e8a7-0bdc-4fe9-8b89-1ec5a1848121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:19:58 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1e6048dd-8f4d-4a16-b083-c2186a20333e tempest-TaggedBootDevicesTest-26589849 None] Created volume successfully.
Sep 27 11:20:08 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=21,cinder:UPDATE=14,cinder:INSERT=10,cinder:DELETE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:20:08 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=26,cinder:SELECT=15,cinder:DELETE=4,cinder:INSERT=7 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:20:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:20:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:20:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:20:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:20:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:20:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.121s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:20:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:20:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.489s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:20:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:20:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:20:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:20:41 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[5512e9db-94c7-4a37-90a1-675f0d994f9d]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:20:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:20:42 devstack quobyte-client[84221]: System call of process 86721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:20:42 devstack quobyte-client[84221]: System call of process 86721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:20:42 devstack quobyte-client[84221]: System call of process 86721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:20:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12" returned: 0 in 0.880s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:20:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:20:43 devstack quobyte-client[84221]: System call of process 86724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:20:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12" returned: 1 in 0.716s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:20:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:20:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.903s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:20:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-81e444b6-43cd-4b85-babf-87b5991eef12', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58cf9e6c-58f0-4058-b77c-1bd96d9915fc', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:20:43 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:20:44 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-f0377eb9-d02f-4d6a-acf1-2c4fe5f1a28e tempest-TaggedBootDevicesTest-26589849 None] attachment_update completed successfully.
Sep 27 11:20:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-66ad16c4-27dd-46a7-a32f-1e87417dc2b2 tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:20:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-66ad16c4-27dd-46a7-a32f-1e87417dc2b2 tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:20:50 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a09ef1-88fd-4ff9-bad8-b149fb559ab9]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:20:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-66ad16c4-27dd-46a7-a32f-1e87417dc2b2 tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:20:51 devstack quobyte-client[84221]: System call of process 86737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:20:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-66ad16c4-27dd-46a7-a32f-1e87417dc2b2 tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c" returned: 0 in 1.669s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:20:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-66ad16c4-27dd-46a7-a32f-1e87417dc2b2 tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.760s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:20:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-66ad16c4-27dd-46a7-a32f-1e87417dc2b2 tempest-TaggedBootDevicesTest-26589849 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49bd29dc-e4cf-4958-9c6b-b7a39d67217c', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:20:52 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-66ad16c4-27dd-46a7-a32f-1e87417dc2b2 tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:20:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-66ad16c4-27dd-46a7-a32f-1e87417dc2b2 tempest-TaggedBootDevicesTest-26589849 None] attachment_update completed successfully.
Sep 27 11:20:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-90d5b47a-fefc-4c8d-a666-696bd0d3892a tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:20:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-90d5b47a-fefc-4c8d-a666-696bd0d3892a tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:20:57 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bae46d6-888c-431c-aa84-5f88cae60d0c]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:20:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-90d5b47a-fefc-4c8d-a666-696bd0d3892a tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:20:58 devstack quobyte-client[84221]: System call of process 86753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:20:58 devstack quobyte-client[84221]: System call of process 86753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:20:58 devstack quobyte-client[84221]: System call of process 86753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:20:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-90d5b47a-fefc-4c8d-a666-696bd0d3892a tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303" returned: 0 in 1.642s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:20:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-90d5b47a-fefc-4c8d-a666-696bd0d3892a tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.821s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:20:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-90d5b47a-fefc-4c8d-a666-696bd0d3892a tempest-TaggedBootDevicesTest-26589849 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-5268557a-e503-4616-94c8-b90bbab02303', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2df27ea0-932f-4629-90d5-fcb31294a8b2', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:20:59 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-90d5b47a-fefc-4c8d-a666-696bd0d3892a tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:21:00 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-df1ff079-b254-45fd-9e68-00c4563593d7 req-90d5b47a-fefc-4c8d-a666-696bd0d3892a tempest-TaggedBootDevicesTest-26589849 None] attachment_update completed successfully.
Sep 27 11:21:10 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:21:10 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=20,cinder:UPDATE=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:21:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (5ccc3d3f-ea90-4c88-8fbf-7f77229dd29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bfd3ec-bb18-4102-8489-b363f1714ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bfd3ec-bb18-4102-8489-b363f1714ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1023627189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c9dca2-9aa0-4e0b-880c-8827344aea6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:21:23Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffd3377-acf8-4514-beed-e86310f7994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffd3377-acf8-4514-beed-e86310f7994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838095d3-8f1e-409b-9093-3b1a79fb9db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838095d3-8f1e-409b-9093-3b1a79fb9db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c9dca2-9aa0-4e0b-880c-8827344aea6a', 'volume_name': 'volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec83aa6d-5439-42de-8fb2-c567396b13a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec83aa6d-5439-42de-8fb2-c567396b13a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9668a8-890b-44d6-bb73-d5c13eb526c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:21:23 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Volume d3c9dca2-9aa0-4e0b-880c-8827344aea6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a', 'volume_size': 1}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1023627189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c9dca2-9aa0-4e0b-880c-8827344aea6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:21:23Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Creating volume d3c9dca2-9aa0-4e0b-880c-8827344aea6a {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:21:23 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:21:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:21:23 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=11, name=volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:21:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a 1073741824" returned: 0 in 0.665s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:21:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:21:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a" returned: 0 in 0.262s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:21:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] <== create_volume: return (1090ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:21:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:21:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9668a8-890b-44d6-bb73-d5c13eb526c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:21:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29239d2-28ba-4f8d-a3bd-cfecb696800b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:21:25 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Volume volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a (d3c9dca2-9aa0-4e0b-880c-8827344aea6a): created successfully
Sep 27 11:21:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29239d2-28ba-4f8d-a3bd-cfecb696800b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:21:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (5ccc3d3f-ea90-4c88-8fbf-7f77229dd29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:21:25 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e539a7e9-aab4-4ac0-96e3-0274ac691656 tempest-VolumesActionsTest-1831896503 None] Created volume successfully.
Sep 27 11:21:25 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a9ff5c94-5f2a-44c1-9112-54f8b3e92753 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a" by "attach_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:21:25 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a9ff5c94-5f2a-44c1-9112-54f8b3e92753 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a" acquired by "attach_volume" :: waited 0.057s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:21:25 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a9ff5c94-5f2a-44c1-9112-54f8b3e92753 tempest-VolumesActionsTest-1831896503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:21:25 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a9ff5c94-5f2a-44c1-9112-54f8b3e92753 tempest-VolumesActionsTest-1831896503 None] Attaching volume d3c9dca2-9aa0-4e0b-880c-8827344aea6a to instance aefa04a5-1765-4cda-807d-790091564083 at mountpoint /dev/vdb on host None.
Sep 27 11:21:26 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a9ff5c94-5f2a-44c1-9112-54f8b3e92753 tempest-VolumesActionsTest-1831896503 None] Attach volume completed successfully.
Sep 27 11:21:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a9ff5c94-5f2a-44c1-9112-54f8b3e92753 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a" released by "attach_volume" :: held 0.361s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:21:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-152744ad-25dc-4d30-9434-29eff5dd7289 tempest-VolumesActionsTest-1136858642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:21:27 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-152744ad-25dc-4d30-9434-29eff5dd7289 tempest-VolumesActionsTest-1136858642 None] Terminate volume connection completed successfully.
Sep 27 11:21:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-152744ad-25dc-4d30-9434-29eff5dd7289 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a-detach_volume" by "detach_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:21:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-152744ad-25dc-4d30-9434-29eff5dd7289 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:21:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-152744ad-25dc-4d30-9434-29eff5dd7289 tempest-VolumesActionsTest-1136858642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:21:27 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-152744ad-25dc-4d30-9434-29eff5dd7289 tempest-VolumesActionsTest-1136858642 None] Detaching volume d3c9dca2-9aa0-4e0b-880c-8827344aea6a from instance aefa04a5-1765-4cda-807d-790091564083.
Sep 27 11:21:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-152744ad-25dc-4d30-9434-29eff5dd7289 tempest-VolumesActionsTest-1136858642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:21:27 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-152744ad-25dc-4d30-9434-29eff5dd7289 tempest-VolumesActionsTest-1136858642 None] Detach volume completed successfully.
Sep 27 11:21:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-152744ad-25dc-4d30-9434-29eff5dd7289 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a-detach_volume" released by "detach_volume" :: held 0.196s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:21:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-898f29eb-d344-4e09-b132-b4312449f273 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a-detach_volume" by "detach_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:21:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-898f29eb-d344-4e09-b132-b4312449f273 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:21:28 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-898f29eb-d344-4e09-b132-b4312449f273 tempest-VolumesActionsTest-1831896503 None] Volume detach called, but volume not attached.
Sep 27 11:21:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-898f29eb-d344-4e09-b132-b4312449f273 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:21:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:21:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:21:29 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:21:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "cinder-quobyte-d3c9dca2-9aa0-4e0b-880c-8827344aea6a" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:21:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-quobyte-d3c9dca2-9aa0-4e0b-880c-8827344aea6a" acquired by "delete_volume" :: waited 0.028s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:21:29 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa32b1-fea3-4d00-b5b8-9aa8bd68781d]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:21:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:21:30 devstack quobyte-client[84221]: System call of process 87098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:21:30 devstack quobyte-client[84221]: System call of process 87098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:21:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a" returned: 0 in 0.585s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:21:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:21:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3c9dca2-9aa0-4e0b-880c-8827344aea6a" returned: 0 in 0.143s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:21:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-quobyte-d3c9dca2-9aa0-4e0b-880c-8827344aea6a" released by "delete_volume" :: held 1.021s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:21:30 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Created reservations ['6923ef8b-e962-4ffd-90e0-c11d26a163af', '0fa32b24-f288-442d-aa53-aa046309ebcf', 'eb11cd5e-80a4-4946-a183-749e12eb6594', 'c2a46337-a244-4f74-bdbf-b2afd21205bc'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:21:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:21:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:21:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:21:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:21:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:21:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:21:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.173s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:21:31 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:21:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Deleted volume successfully.
Sep 27 11:21:32 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0154bf0e-b3a8-4626-b31f-62f8b9a0b627 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-d3c9dca2-9aa0-4e0b-880c-8827344aea6a-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:21:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:21:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:21:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:21:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:21:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:21:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.161s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:21:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:21:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 1.232s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:21:40 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:21:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:21:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=22,cinder:DELETE=1,cinder:SELECT=15,cinder:INSERT=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:22:01 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (9163bad3-4871-4c32-b410-e3fee4ec457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9431a02-e62a-4ac3-91d0-7d0e0859a2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9431a02-e62a-4ac3-91d0-7d0e0859a2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1756815671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8176c28-14a3-4ddd-adfe-cff5c132e916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:01Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6dd86e-beb3-4a83-a191-4de5a384264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6dd86e-beb3-4a83-a191-4de5a384264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fc78bc-7ed3-4d99-b61e-e97cd2dfd72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fc78bc-7ed3-4d99-b61e-e97cd2dfd72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8176c28-14a3-4ddd-adfe-cff5c132e916', 'volume_name': 'volume-d8176c28-14a3-4ddd-adfe-cff5c132e916', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d665e82-2a36-43b8-b430-0ed4857a944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d665e82-2a36-43b8-b430-0ed4857a944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaec7d7-3058-48ec-83f5-06943b94606d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:01 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Volume d8176c28-14a3-4ddd-adfe-cff5c132e916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8176c28-14a3-4ddd-adfe-cff5c132e916', 'volume_size': 1}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1756815671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8176c28-14a3-4ddd-adfe-cff5c132e916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:01Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Creating volume d8176c28-14a3-4ddd-adfe-cff5c132e916 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:22:01 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:22:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d8176c28-14a3-4ddd-adfe-cff5c132e916 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:02 devstack quobyte-client[84221]: System call of process 87959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:02 devstack quobyte-client[84221]: System call of process 87959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:02 devstack quobyte-client[84221]: System call of process 87959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:02 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=12, name=volume-d8176c28-14a3-4ddd-adfe-cff5c132e916, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:22:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d8176c28-14a3-4ddd-adfe-cff5c132e916 1073741824" returned: 0 in 1.188s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d8176c28-14a3-4ddd-adfe-cff5c132e916 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d8176c28-14a3-4ddd-adfe-cff5c132e916" returned: 0 in 0.538s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] <== create_volume: return (1931ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:22:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:03 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaec7d7-3058-48ec-83f5-06943b94606d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8176c28-14a3-4ddd-adfe-cff5c132e916', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:03 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f399ad04-9ef5-4ede-95dd-f1d12a031994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:04 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Volume volume-d8176c28-14a3-4ddd-adfe-cff5c132e916 (d8176c28-14a3-4ddd-adfe-cff5c132e916): created successfully
Sep 27 11:22:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f399ad04-9ef5-4ede-95dd-f1d12a031994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (9163bad3-4871-4c32-b410-e3fee4ec457f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9bdbeba9-9ee2-4123-a55e-37666ee3785b tempest-VolumesActionsTest-1831896503 None] Created volume successfully.
Sep 27 11:22:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "cinder-d8176c28-14a3-4ddd-adfe-cff5c132e916-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-d8176c28-14a3-4ddd-adfe-cff5c132e916-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:07 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "cinder-quobyte-d8176c28-14a3-4ddd-adfe-cff5c132e916" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-quobyte-d8176c28-14a3-4ddd-adfe-cff5c132e916" acquired by "delete_volume" :: waited 0.057s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:07 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b06282-8110-43c4-840b-cb127091302b]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:22:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d8176c28-14a3-4ddd-adfe-cff5c132e916 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:08 devstack quobyte-client[84221]: System call of process 88012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:08 devstack quobyte-client[84221]: System call of process 88012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:08 devstack quobyte-client[84221]: System call of process 88012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d8176c28-14a3-4ddd-adfe-cff5c132e916" returned: 0 in 0.844s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d8176c28-14a3-4ddd-adfe-cff5c132e916 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d8176c28-14a3-4ddd-adfe-cff5c132e916" returned: 0 in 0.242s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-quobyte-d8176c28-14a3-4ddd-adfe-cff5c132e916" released by "delete_volume" :: held 1.394s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:09 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Created reservations ['6f0a9a0f-c174-4ff7-9099-581e96c16b31', '4b6957d1-d318-4598-a561-099bd2426880', 'e8f55af7-96cf-4fb4-9f9a-128b6e9b1eaa', '7ba9d2d4-8cf5-4989-b83c-cdad2029d70c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:22:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.297s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:10 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:22:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Deleted volume successfully.
Sep 27 11:22:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5318f727-40ac-4818-a8f7-ba70b7087191 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-d8176c28-14a3-4ddd-adfe-cff5c132e916-delete_volume" released by "delete_volume" :: held 4.322s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:12 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:22:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (c06a9e04-30d1-4f2b-84e0-fc9868bf1455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96520005-1670-4ef8-9b74-f62caa9980d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96520005-1670-4ef8-9b74-f62caa9980d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-26709898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36847b47-5b69-48a1-a517-4d3ce1af2185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:12Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6785df92-069a-4cd4-9631-30f371d2c145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6785df92-069a-4cd4-9631-30f371d2c145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afc5e59-5819-4e7e-861e-08d71bf7df03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afc5e59-5819-4e7e-861e-08d71bf7df03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36847b47-5b69-48a1-a517-4d3ce1af2185', 'volume_name': 'volume-36847b47-5b69-48a1-a517-4d3ce1af2185', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9e01f0-88c5-47be-8af8-da1a2328c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9e01f0-88c5-47be-8af8-da1a2328c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23f209f-3ace-4109-901a-a4a33e96249b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:13 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Volume 36847b47-5b69-48a1-a517-4d3ce1af2185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36847b47-5b69-48a1-a517-4d3ce1af2185', 'volume_size': 1}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-26709898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36847b47-5b69-48a1-a517-4d3ce1af2185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:12Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Creating volume 36847b47-5b69-48a1-a517-4d3ce1af2185 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:22:13 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:22:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-36847b47-5b69-48a1-a517-4d3ce1af2185 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:13 devstack quobyte-client[84221]: System call of process 88065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:13 devstack quobyte-client[84221]: System call of process 88065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:13 devstack quobyte-client[84221]: System call of process 88065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:13 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=13, name=volume-36847b47-5b69-48a1-a517-4d3ce1af2185, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:22:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-36847b47-5b69-48a1-a517-4d3ce1af2185 1073741824" returned: 0 in 1.182s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-36847b47-5b69-48a1-a517-4d3ce1af2185 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-36847b47-5b69-48a1-a517-4d3ce1af2185" returned: 0 in 0.603s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] <== create_volume: return (1964ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:22:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23f209f-3ace-4109-901a-a4a33e96249b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36847b47-5b69-48a1-a517-4d3ce1af2185', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135fb3df-aa09-4650-bb20-9fb9307d0eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:16 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Volume volume-36847b47-5b69-48a1-a517-4d3ce1af2185 (36847b47-5b69-48a1-a517-4d3ce1af2185): created successfully
Sep 27 11:22:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135fb3df-aa09-4650-bb20-9fb9307d0eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (c06a9e04-30d1-4f2b-84e0-fc9868bf1455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:16 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b25e9e16-da82-4458-9f9d-ec5c3d8940d0 tempest-VolumesActionsTest-1831896503 None] Created volume successfully.
Sep 27 11:22:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-0163ccba-926d-4a98-b196-3b95c833a3c4 req-1e9ad04a-5079-46ec-adfa-75c4f8835659 tempest-TaggedAttachmentsTest-1491326788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-0163ccba-926d-4a98-b196-3b95c833a3c4 req-1e9ad04a-5079-46ec-adfa-75c4f8835659 tempest-TaggedAttachmentsTest-1491326788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:17 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ae8805-ba88-42ed-89e1-c09a00ed3f35]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:22:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-0163ccba-926d-4a98-b196-3b95c833a3c4 req-1e9ad04a-5079-46ec-adfa-75c4f8835659 tempest-TaggedAttachmentsTest-1491326788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "cinder-36847b47-5b69-48a1-a517-4d3ce1af2185-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-36847b47-5b69-48a1-a517-4d3ce1af2185-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:19 devstack quobyte-client[84221]: System call of process 88085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:19 devstack quobyte-client[84221]: System call of process 88085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:19 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:19 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "cinder-quobyte-36847b47-5b69-48a1-a517-4d3ce1af2185" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-0163ccba-926d-4a98-b196-3b95c833a3c4 req-1e9ad04a-5079-46ec-adfa-75c4f8835659 tempest-TaggedAttachmentsTest-1491326788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f" returned: 0 in 2.278s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-0163ccba-926d-4a98-b196-3b95c833a3c4 req-1e9ad04a-5079-46ec-adfa-75c4f8835659 tempest-TaggedAttachmentsTest-1491326788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.399s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:19 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-quobyte-36847b47-5b69-48a1-a517-4d3ce1af2185" acquired by "delete_volume" :: waited 0.142s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:19 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb92699-8951-46c6-9c2f-aeb6f7868012]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:22:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-36847b47-5b69-48a1-a517-4d3ce1af2185 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-0163ccba-926d-4a98-b196-3b95c833a3c4 req-1e9ad04a-5079-46ec-adfa-75c4f8835659 tempest-TaggedAttachmentsTest-1491326788 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e0d4278-0219-47a1-9807-1889f2293469', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:22:20 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-0163ccba-926d-4a98-b196-3b95c833a3c4 req-1e9ad04a-5079-46ec-adfa-75c4f8835659 tempest-TaggedAttachmentsTest-1491326788 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-0163ccba-926d-4a98-b196-3b95c833a3c4 req-1e9ad04a-5079-46ec-adfa-75c4f8835659 tempest-TaggedAttachmentsTest-1491326788 None] attachment_update completed successfully.
Sep 27 11:22:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-36847b47-5b69-48a1-a517-4d3ce1af2185" returned: 0 in 1.072s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-36847b47-5b69-48a1-a517-4d3ce1af2185 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-36847b47-5b69-48a1-a517-4d3ce1af2185" returned: 0 in 0.297s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-quobyte-36847b47-5b69-48a1-a517-4d3ce1af2185" released by "delete_volume" :: held 1.792s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:22 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Created reservations ['a4475448-0cf3-44ea-a28c-e0c91ba776e2', '5500056d-e8f4-4125-b621-b1884950d4d0', '8a30bba5-4116-432c-bc76-5cdd7bd6e2b6', 'c1834f18-eba3-4102-9a18-8b279027867f'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:22:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.145s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:23 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:22:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Deleted volume successfully.
Sep 27 11:22:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5eaab041-4af3-414e-a3fb-70036e5365a3 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-36847b47-5b69-48a1-a517-4d3ce1af2185-delete_volume" released by "delete_volume" :: held 4.926s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (dd37b6d0-6435-4275-990c-2479c0d0c94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7066a31-06bf-426a-91c0-7ad8b7cc2e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7066a31-06bf-426a-91c0-7ad8b7cc2e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706642672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed3d969-70de-49cf-b81e-c1f0feadcd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:24Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2293d251-b4fd-409b-9fb3-58d876509a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2293d251-b4fd-409b-9fb3-58d876509a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a592129c-5015-4b84-af9b-aa5e75a272b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a592129c-5015-4b84-af9b-aa5e75a272b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed3d969-70de-49cf-b81e-c1f0feadcd0b', 'volume_name': 'volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77975cf-4987-438d-9a54-8ec559a820f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77975cf-4987-438d-9a54-8ec559a820f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88840d9f-8a59-45a8-97a4-62d05a7f7c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:24 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Volume 0ed3d969-70de-49cf-b81e-c1f0feadcd0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b', 'volume_size': 1}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706642672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed3d969-70de-49cf-b81e-c1f0feadcd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:24Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Creating volume 0ed3d969-70de-49cf-b81e-c1f0feadcd0b {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:22:24 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:22:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:25 devstack quobyte-client[84221]: System call of process 88138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:25 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=14, name=volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:22:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b 1073741824" returned: 0 in 0.688s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b" returned: 0 in 0.146s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] <== create_volume: return (940ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:22:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88840d9f-8a59-45a8-97a4-62d05a7f7c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426819ec-63f4-40d9-9825-e0e5aa9eccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:26 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Volume volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b (0ed3d969-70de-49cf-b81e-c1f0feadcd0b): created successfully
Sep 27 11:22:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426819ec-63f4-40d9-9825-e0e5aa9eccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (dd37b6d0-6435-4275-990c-2479c0d0c94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:26 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-289262f1-db81-4399-8ecd-0115de8f1f36 tempest-VolumesActionsTest-1831896503 None] Created volume successfully.
Sep 27 11:22:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Acquiring lock "cinder-0ed3d969-70de-49cf-b81e-c1f0feadcd0b-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Lock "cinder-0ed3d969-70de-49cf-b81e-c1f0feadcd0b-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Acquiring lock "cinder-quobyte-0ed3d969-70de-49cf-b81e-c1f0feadcd0b" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Lock "cinder-quobyte-0ed3d969-70de-49cf-b81e-c1f0feadcd0b" acquired by "delete_volume" :: waited 0.030s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27cadf-7dcb-4bca-9bab-ebe7e1428127]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:22:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:28 devstack quobyte-client[84221]: System call of process 88142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:28 devstack quobyte-client[84221]: System call of process 88142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:28 devstack quobyte-client[84221]: System call of process 88142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b" returned: 0 in 0.841s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ed3d969-70de-49cf-b81e-c1f0feadcd0b" returned: 0 in 0.267s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Lock "cinder-quobyte-0ed3d969-70de-49cf-b81e-c1f0feadcd0b" released by "delete_volume" :: held 1.459s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:29 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Created reservations ['0f971943-5ea0-4280-aa1d-991443392092', '802793a1-fdce-48da-9e86-726fb6a39d75', '3c303eed-bd98-4211-b1f6-f70f78d9a8f4', '96539893-3179-4368-b301-6e024a41e977'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:22:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.278s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:30 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:22:30 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Deleted volume successfully.
Sep 27 11:22:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41fa8e65-55fe-4598-b5fe-614a5183791b tempest-VolumesActionsTest-1136858642 None] Lock "cinder-0ed3d969-70de-49cf-b81e-c1f0feadcd0b-delete_volume" released by "delete_volume" :: held 4.000s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:32 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (1d77980e-5f02-48f3-8eb0-012ae159508f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd597cd-0e52-4bd6-9957-717611c76234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd597cd-0e52-4bd6-9957-717611c76234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1484941214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a52c94-761b-46b4-b29c-20e123098add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:32Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349f612e-43c4-49cd-86e3-3fdc18371489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349f612e-43c4-49cd-86e3-3fdc18371489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed3eb9f-d0f6-4735-b2a5-0bf728e4b5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed3eb9f-d0f6-4735-b2a5-0bf728e4b5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a52c94-761b-46b4-b29c-20e123098add', 'volume_name': 'volume-d5a52c94-761b-46b4-b29c-20e123098add', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e427e2ef-1049-4432-8a6a-12ea181ef46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e427e2ef-1049-4432-8a6a-12ea181ef46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814a0ba4-a8a8-4b74-928b-ec375381692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:32 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Volume d5a52c94-761b-46b4-b29c-20e123098add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a52c94-761b-46b4-b29c-20e123098add', 'volume_size': 1}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1484941214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a52c94-761b-46b4-b29c-20e123098add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:32Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Creating volume d5a52c94-761b-46b4-b29c-20e123098add {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:22:32 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d5a52c94-761b-46b4-b29c-20e123098add 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:32 devstack quobyte-client[84221]: System call of process 88153 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:32 devstack quobyte-client[84221]: System call of process 88153 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:32 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=15, name=volume-d5a52c94-761b-46b4-b29c-20e123098add, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d5a52c94-761b-46b4-b29c-20e123098add 1073741824" returned: 0 in 0.417s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d5a52c94-761b-46b4-b29c-20e123098add {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d5a52c94-761b-46b4-b29c-20e123098add" returned: 0 in 0.229s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] <== create_volume: return (713ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:22:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814a0ba4-a8a8-4b74-928b-ec375381692d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a52c94-761b-46b4-b29c-20e123098add', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21beee9e-0aab-46b6-8c29-bb5dca9d4063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:33 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Volume volume-d5a52c94-761b-46b4-b29c-20e123098add (d5a52c94-761b-46b4-b29c-20e123098add): created successfully
Sep 27 11:22:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21beee9e-0aab-46b6-8c29-bb5dca9d4063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (1d77980e-5f02-48f3-8eb0-012ae159508f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9132b2b9-1fbb-42c5-b7f1-eee4576fbe66 tempest-VolumesActionsTest-1831896503 None] Created volume successfully.
Sep 27 11:22:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "cinder-d5a52c94-761b-46b4-b29c-20e123098add-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-d5a52c94-761b-46b4-b29c-20e123098add-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:34 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "cinder-quobyte-d5a52c94-761b-46b4-b29c-20e123098add" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-quobyte-d5a52c94-761b-46b4-b29c-20e123098add" acquired by "delete_volume" :: waited 0.027s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:34 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ac3103-691a-4cbf-b8c0-65368d5181b0]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:22:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d5a52c94-761b-46b4-b29c-20e123098add {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:35 devstack quobyte-client[84221]: System call of process 88162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:35 devstack quobyte-client[84221]: System call of process 88162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:35 devstack quobyte-client[84221]: System call of process 88162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d5a52c94-761b-46b4-b29c-20e123098add" returned: 0 in 0.578s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d5a52c94-761b-46b4-b29c-20e123098add {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d5a52c94-761b-46b4-b29c-20e123098add" returned: 0 in 0.135s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-quobyte-d5a52c94-761b-46b4-b29c-20e123098add" released by "delete_volume" :: held 0.898s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Created reservations ['13c0fbb5-1d85-47f1-974d-cf5e237dec0a', '3c25abd7-ecb2-4e16-a6d9-74ce7cd7d5c7', '906d6580-5572-4e96-966c-42b94a5e0a2a', '06a2a8ba-f09b-4b94-8fa9-4166ed0c7bcf'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.113s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:22:36 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Deleted volume successfully.
Sep 27 11:22:36 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cc0841de-533b-4a0c-93ec-491ebb168079 tempest-VolumesActionsTest-1136858642 None] Lock "cinder-d5a52c94-761b-46b4-b29c-20e123098add-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:38 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (d5cdd7de-540d-49a9-a82b-281dadf04cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460a359a-4a6b-4a86-9505-eab017ff0d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460a359a-4a6b-4a86-9505-eab017ff0d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22676847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653e6cbc-8d09-434f-bf9d-70facfd3ef6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:38Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54e2768-fa26-435e-8206-43b7ceb175ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54e2768-fa26-435e-8206-43b7ceb175ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a248e63-46ca-40fa-a2b3-9381ef0978cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a248e63-46ca-40fa-a2b3-9381ef0978cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653e6cbc-8d09-434f-bf9d-70facfd3ef6c', 'volume_name': 'volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4067de4-ad1e-4238-9898-294c703b7079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4067de4-ad1e-4238-9898-294c703b7079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08459f1-6338-443a-9594-a0205c3e6871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:38 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Volume 653e6cbc-8d09-434f-bf9d-70facfd3ef6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c', 'volume_size': 1}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22676847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653e6cbc-8d09-434f-bf9d-70facfd3ef6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f7fec446c44511a8f5a6db4cece801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:22:38Z,use_quota=True,user_id='b84ed639a4a148c885d7c4a5859a5885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Creating volume 653e6cbc-8d09-434f-bf9d-70facfd3ef6c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:22:38 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:38 devstack quobyte-client[84221]: System call of process 88174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:22:38 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=16, name=volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:22:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c 1073741824" returned: 0 in 0.517s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.273s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c" returned: 0 in 0.197s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] <== create_volume: return (821ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08459f1-6338-443a-9594-a0205c3e6871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7848b5f-7836-496d-88fd-81d6d8636933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:22:39 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Volume volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c (653e6cbc-8d09-434f-bf9d-70facfd3ef6c): created successfully
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7848b5f-7836-496d-88fd-81d6d8636933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:22:39 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Flow 'volume_create_manager' (d5cdd7de-540d-49a9-a82b-281dadf04cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:22:39 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-95c6f8e8-d4bb-4fb8-83cf-acf88a17f81d tempest-VolumesActionsTest-1831896503 None] Created volume successfully.
Sep 27 11:22:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "cinder-653e6cbc-8d09-434f-bf9d-70facfd3ef6c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-653e6cbc-8d09-434f-bf9d-70facfd3ef6c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "cinder-quobyte-653e6cbc-8d09-434f-bf9d-70facfd3ef6c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:22:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-quobyte-653e6cbc-8d09-434f-bf9d-70facfd3ef6c" acquired by "delete_volume" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:22:41 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efbfb73-c8b3-4fdc-8dcf-0fe0001f1af5]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:22:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c" returned: 0 in 0.524s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-653e6cbc-8d09-434f-bf9d-70facfd3ef6c" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-quobyte-653e6cbc-8d09-434f-bf9d-70facfd3ef6c" released by "delete_volume" :: held 0.803s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Created reservations ['0b060a34-774f-4bb0-9b00-347d68a7298e', '24194d55-4008-4707-b339-3465dec24d46', '21666060-720a-499a-bd24-a8e6a1d15c0d', '6263af28-a67e-4904-a072-0227b8fc8aa8'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.113s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:22:42 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:22:43 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Deleted volume successfully.
Sep 27 11:22:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-daf2c950-e7c6-47ac-bb69-4890d59ed277 tempest-VolumesActionsTest-1831896503 None] Lock "cinder-653e6cbc-8d09-434f-bf9d-70facfd3ef6c-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:22:52 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=42,cinder:UPDATE=53,cinder:INSERT=13,cinder:DELETE=4 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:22:53 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=50,cinder:DELETE=6,cinder:SELECT=29,cinder:INSERT=7 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:22:54 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-de2648b5-f302-4464-a147-e6a50672c448 req-e74df712-cfbe-49af-b2b8-93d6df7921a9 tempest-TaggedAttachmentsTest-1491326788 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:54 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-de2648b5-f302-4464-a147-e6a50672c448 req-e74df712-cfbe-49af-b2b8-93d6df7921a9 tempest-TaggedAttachmentsTest-1491326788 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:22:54 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-de2648b5-f302-4464-a147-e6a50672c448 req-e74df712-cfbe-49af-b2b8-93d6df7921a9 tempest-TaggedAttachmentsTest-1491326788 None] Terminate volume connection completed successfully.
Sep 27 11:22:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-de2648b5-f302-4464-a147-e6a50672c448 req-e74df712-cfbe-49af-b2b8-93d6df7921a9 tempest-TaggedAttachmentsTest-1491326788 None] Deleting attachment 0e0d4278-0219-47a1-9807-1889f2293469. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:23:04 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:23:05 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Flow 'volume_create_manager' (b15641f1-b729-4f02-a7d7-29d7d33e9d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e56181-fa7c-423d-8d52-7579d6f3fc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e56181-fa7c-423d-8d52-7579d6f3fc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-103596111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41732c1-5ff2-49fb-83ca-0a2e86529f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb879b05e6d24d398567395adb60c101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:23:05Z,use_quota=True,user_id='61bcf3f5208c4d58a50ba3e968bf9be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef222aa3-bdad-43c0-b8f5-435bcad4ae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef222aa3-bdad-43c0-b8f5-435bcad4ae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209e836c-75e4-4cba-a497-0a8462d35a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.image.glance [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Creating Keystone auth plugin from conf {{(pid=84197) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209e836c-75e4-4cba-a497-0a8462d35a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd41732c1-5ff2-49fb-83ca-0a2e86529f92', 'volume_name': 'volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d2b1030>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3794f9f1-4196-4f97-8c31-40b970792374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3794f9f1-4196-4f97-8c31-40b970792374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4b32d6-d92b-485a-ad30-fdcb5627a469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:05 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Volume d41732c1-5ff2-49fb-83ca-0a2e86529f92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d2b1030>}
Sep 27 11:23:05 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Cloning d41732c1-5ff2-49fb-83ca-0a2e86529f92 from image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3  at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]). {{(pid=84197) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 27 11:23:06 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 27 11:23:06 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Image download 20.69 MB at 20.69 MB/s
Sep 27 11:23:06 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da081e3-a3e2-4eab-b644-625ea4d2efe4]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:23:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:07 devstack sudo[88247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD
Sep 27 11:23:07 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:23:09 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root
Sep 27 11:23:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD" returned: 0 in 2.240s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:09 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Temporary image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 is fetched for user 61bcf3f5208c4d58a50ba3e968bf9be7. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 27 11:23:09 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[80081da0-0f3e-4ca7-a5a2-c591b1c7a340]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:23:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:09 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD
Sep 27 11:23:09 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:23:11 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD" returned: 0 in 2.191s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-103596111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41732c1-5ff2-49fb-83ca-0a2e86529f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb879b05e6d24d398567395adb60c101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:23:05Z,use_quota=True,user_id='61bcf3f5208c4d58a50ba3e968bf9be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Creating volume d41732c1-5ff2-49fb-83ca-0a2e86529f92 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:23:11 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:23:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:11 devstack quobyte-client[84221]: System call of process 88257 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:11 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=17, name=volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:23:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 1073741824" returned: 0 in 0.327s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92" returned: 0 in 0.094s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] <== create_volume: return (511ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:23:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.543s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:12 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Attempting download of 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}])) to volume d41732c1-5ff2-49fb-83ca-0a2e86529f92. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 27 11:23:12 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa618997-56d5-4d7d-9ccb-7b98e0ceeea3]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:23:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_stmr7new {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_stmr7new" returned: 0 in 0.358s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_stmr7new {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_stmr7new" returned: 1 in 0.389s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_stmr7new' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:23:13 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92c1dfd-2617-4344-88c4-bb6a69d36593]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:23:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:13 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 was qcow2, converting to raw {{(pid=84197) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 27 11:23:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:14 devstack quobyte-client[84221]: System call of process 88269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:14 devstack quobyte-client[84221]: System call of process 88269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:14 devstack quobyte-client[84221]: System call of process 88269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:14 devstack quobyte-client[84221]: System call of process 88269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:14 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=17, name=volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:23:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92" returned: 0 in 1.495s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:15 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_7hvdsb43devstack@QuobyteHD, size 112.00 MB, duration 1.53 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:23:15 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Converted 112.00 MB image at 73.31 MB/s
Sep 27 11:23:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 1G" returned: 0 in 0.160s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:15 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b940059e-8af1-418a-b5c9-c24e55905f47]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:23:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92" returned: 0 in 0.452s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92" returned: 1 in 0.390s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:23:16 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Downloaded image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}])) to volume d41732c1-5ff2-49fb-83ca-0a2e86529f92 successfully. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 27 11:23:16 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Temporary image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 for user 61bcf3f5208c4d58a50ba3e968bf9be7 is deleted. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 27 11:23:16 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Marking volume d41732c1-5ff2-49fb-83ca-0a2e86529f92 as bootable. {{(pid=84197) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 27 11:23:16 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Copying metadata from image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 to d41732c1-5ff2-49fb-83ca-0a2e86529f92. {{(pid=84197) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 27 11:23:16 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Creating volume glance metadata for volume d41732c1-5ff2-49fb-83ca-0a2e86529f92 backed by image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84197) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 27 11:23:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4b32d6-d92b-485a-ad30-fdcb5627a469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d2b1030>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237bb0ee-cad3-42d3-9a58-288947307798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:17 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Volume volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 (d41732c1-5ff2-49fb-83ca-0a2e86529f92): created successfully
Sep 27 11:23:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237bb0ee-cad3-42d3-9a58-288947307798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Flow 'volume_create_manager' (b15641f1-b729-4f02-a7d7-29d7d33e9d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:23:17 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f419da78-d78b-44c5-b523-6826e40c7d3d tempest-VolumesImageMetadata-1599905313 None] Created volume successfully.
Sep 27 11:23:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Acquiring lock "cinder-d41732c1-5ff2-49fb-83ca-0a2e86529f92-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:23:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Lock "cinder-d41732c1-5ff2-49fb-83ca-0a2e86529f92-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:23:18 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:23:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Acquiring lock "cinder-quobyte-d41732c1-5ff2-49fb-83ca-0a2e86529f92" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:23:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Lock "cinder-quobyte-d41732c1-5ff2-49fb-83ca-0a2e86529f92" acquired by "delete_volume" :: waited 0.018s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:23:18 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4904646e-3fcf-4d5a-806a-31e882214a87]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:23:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:19 devstack quobyte-client[84221]: System call of process 88282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92" returned: 0 in 0.430s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:19 devstack quobyte-client[84221]: System call of process 88284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92" returned: 1 in 0.516s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:23:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d41732c1-5ff2-49fb-83ca-0a2e86529f92" returned: 0 in 0.087s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Lock "cinder-quobyte-d41732c1-5ff2-49fb-83ca-0a2e86529f92" released by "delete_volume" :: held 1.237s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Created reservations ['fa52b7ab-4060-4d6e-b9cc-f64ae4d15fc6', 'a028ce8b-0a54-46b3-aadb-73f125c263ea', '9ac414d6-083c-4135-bbc7-63e99ad9e926', '3a63da27-11ec-491b-bf66-aee6a33731a5'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.085s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:23:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Deleted volume successfully.
Sep 27 11:23:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a25ad0dc-f891-4369-869a-c8a4d8302f28 tempest-VolumesImageMetadata-1599905313 None] Lock "cinder-d41732c1-5ff2-49fb-83ca-0a2e86529f92-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:23:26 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:23:26 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Flow 'volume_create_manager' (8783236d-1737-4200-91fa-b11122ab63d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d791f2f7-ab67-4c20-af03-c0369de64c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d791f2f7-ab67-4c20-af03-c0369de64c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1245772826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a483d43a442340a98510bdd5b2337ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:23:26Z,use_quota=True,user_id='49ee25b1823c4547b174350e8a9c8305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57aded71-f6f9-4be3-93fe-e4cf29c4ebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57aded71-f6f9-4be3-93fe-e4cf29c4ebf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddeebe30-95b3-4e22-8c37-e6f7cf3d7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddeebe30-95b3-4e22-8c37-e6f7cf3d7870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81', 'volume_name': 'volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d1c828-0244-4a7e-8d10-ebf0c8a0e38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d1c828-0244-4a7e-8d10-ebf0c8a0e38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc6b1d9-704b-4505-98c5-554e503f275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:27 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Volume d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81', 'volume_size': 1}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1245772826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a483d43a442340a98510bdd5b2337ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:23:26Z,use_quota=True,user_id='49ee25b1823c4547b174350e8a9c8305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Creating volume d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:23:27 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:23:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:28 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=18, name=volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:23:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81 1073741824" returned: 0 in 0.549s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81" returned: 0 in 0.227s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] <== create_volume: return (915ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:23:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc6b1d9-704b-4505-98c5-554e503f275b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f234bc-8172-4f7b-a74c-e568241a7fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:29 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Volume volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81 (d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81): created successfully
Sep 27 11:23:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f234bc-8172-4f7b-a74c-e568241a7fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Flow 'volume_create_manager' (8783236d-1737-4200-91fa-b11122ab63d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:23:29 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0d4dd3e5-2d31-46bd-b06a-0fed97c37c0c tempest-AbsoluteLimitsTests-749309853 None] Created volume successfully.
Sep 27 11:23:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Acquiring lock "cinder-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:23:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Lock "cinder-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81-delete_volume" acquired by "delete_volume" :: waited 0.167s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:23:31 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:23:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Acquiring lock "cinder-quobyte-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:23:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Lock "cinder-quobyte-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81" acquired by "delete_volume" :: waited 0.065s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:23:31 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4355a0cd-a302-4d48-837f-7ba0bc258e00]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:23:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:32 devstack quobyte-client[84221]: System call of process 88371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81" returned: 0 in 1.205s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81" returned: 0 in 0.173s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:32 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Lock "cinder-quobyte-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81" released by "delete_volume" :: held 1.720s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:23:33 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Created reservations ['22f2687d-35a5-4e33-a624-6b42a2f0da18', '25bb8a8e-f788-4b70-8e8b-e4707a2344ea', '24ff50de-a3cb-40fa-886f-987c4ae1592d', '2f0a9b83-0c5d-413b-86ac-8f5ac7a239a6'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:23:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:23:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:23:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.390s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:34 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:23:34 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Deleted volume successfully.
Sep 27 11:23:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-28cf751b-9971-489a-be58-b786d6126a07 tempest-AbsoluteLimitsTests-749309853 None] Lock "cinder-d68f7d0d-2ad3-4eeb-bf8c-32b0a4fc0a81-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:23:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:23:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:23:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:23:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.099s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.439s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:23:43 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Flow 'volume_create_manager' (928d69b7-ab62-4bef-bbb5-dac51901fa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8f4451-4a73-41fe-9f6b-d8f05ac240c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8f4451-4a73-41fe-9f6b-d8f05ac240c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-252164360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5645cde5-8876-4de1-948a-dc065394d8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa91e1928e243c48bebd04373651104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:23:42Z,use_quota=True,user_id='336acbe727b746799fe1f5be5ea1b5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b717f4c-42d2-4c14-aed4-bee2669b8697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b717f4c-42d2-4c14-aed4-bee2669b8697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebd1c30-d5c0-4de8-9296-83e88692fac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebd1c30-d5c0-4de8-9296-83e88692fac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5645cde5-8876-4de1-948a-dc065394d8de', 'volume_name': 'volume-5645cde5-8876-4de1-948a-dc065394d8de', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33203560-27aa-442f-b0b9-d04c7e9742d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33203560-27aa-442f-b0b9-d04c7e9742d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357af4ab-4237-405c-b1bc-7330641e83b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:43 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Volume 5645cde5-8876-4de1-948a-dc065394d8de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5645cde5-8876-4de1-948a-dc065394d8de', 'volume_size': 1}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-252164360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5645cde5-8876-4de1-948a-dc065394d8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa91e1928e243c48bebd04373651104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:23:42Z,use_quota=True,user_id='336acbe727b746799fe1f5be5ea1b5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Creating volume 5645cde5-8876-4de1-948a-dc065394d8de {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:23:43 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5645cde5-8876-4de1-948a-dc065394d8de 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:43 devstack quobyte-client[84221]: System call of process 88396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:43 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=19, name=volume-5645cde5-8876-4de1-948a-dc065394d8de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Acquiring lock "cinder-b9713b7a-f2b3-4147-affc-bf8a7d72d32f-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:23:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Lock "cinder-b9713b7a-f2b3-4147-affc-bf8a7d72d32f-delete_volume" acquired by "delete_volume" :: waited 0.290s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:23:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=30,cinder:UPDATE=19,cinder:INSERT=20,cinder:DELETE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:23:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5645cde5-8876-4de1-948a-dc065394d8de 1073741824" returned: 0 in 1.332s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5645cde5-8876-4de1-948a-dc065394d8de {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5645cde5-8876-4de1-948a-dc065394d8de" returned: 0 in 2.828s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] <== create_volume: return (4248ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:23:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.266s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:47 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:23:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Acquiring lock "cinder-quobyte-b9713b7a-f2b3-4147-affc-bf8a7d72d32f" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:23:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357af4ab-4237-405c-b1bc-7330641e83b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5645cde5-8876-4de1-948a-dc065394d8de', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7ade28-8213-4843-b6a5-c6bb60b471d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:23:48 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Volume volume-5645cde5-8876-4de1-948a-dc065394d8de (5645cde5-8876-4de1-948a-dc065394d8de): created successfully
Sep 27 11:23:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7ade28-8213-4843-b6a5-c6bb60b471d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:23:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Flow 'volume_create_manager' (928d69b7-ab62-4bef-bbb5-dac51901fa45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:23:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Lock "cinder-quobyte-b9713b7a-f2b3-4147-affc-bf8a7d72d32f" acquired by "delete_volume" :: waited 0.180s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:23:48 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-35c18682-6245-4ffe-81b3-e948c77af925 tempest-VolumesMetadataTest-1779490810 None] Created volume successfully.
Sep 27 11:23:48 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[34158287-ed42-4736-ae04-f1f5ec166a07]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:23:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:50 devstack quobyte-client[84221]: System call of process 88635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:50 devstack quobyte-client[84221]: System call of process 88635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:50 devstack quobyte-client[84221]: System call of process 88635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f" returned: 0 in 1.978s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b9713b7a-f2b3-4147-affc-bf8a7d72d32f" returned: 0 in 0.392s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Lock "cinder-quobyte-b9713b7a-f2b3-4147-affc-bf8a7d72d32f" released by "delete_volume" :: held 2.882s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:23:51 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Created reservations ['1bda9752-1d0a-4148-89a7-dd4f657a412a', '796f6ba1-749f-4717-a45a-b8bdf8cdca14', '8c8ed0ad-e4de-4132-9f9a-c357a314dfb3', 'bb9fdc35-424f-48c5-b2bb-f90c41580116'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:23:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:23:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:23:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.311s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:52 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:23:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Deleted volume successfully.
Sep 27 11:23:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Acquiring lock "cinder-5645cde5-8876-4de1-948a-dc065394d8de-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:23:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Lock "cinder-5645cde5-8876-4de1-948a-dc065394d8de-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:23:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e2325ed8-88f5-4c7b-8c7a-73048ea909f9 tempest-TaggedAttachmentsTest-1491326788 None] Lock "cinder-b9713b7a-f2b3-4147-affc-bf8a7d72d32f-delete_volume" released by "delete_volume" :: held 8.899s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:23:53 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:23:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Acquiring lock "cinder-quobyte-5645cde5-8876-4de1-948a-dc065394d8de" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:23:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Lock "cinder-quobyte-5645cde5-8876-4de1-948a-dc065394d8de" acquired by "delete_volume" :: waited 0.015s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:23:53 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[871dac3b-4ce5-4f02-835c-283a796c3a59]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:23:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5645cde5-8876-4de1-948a-dc065394d8de {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:53 devstack quobyte-client[84221]: System call of process 88728 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:23:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5645cde5-8876-4de1-948a-dc065394d8de" returned: 0 in 0.513s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5645cde5-8876-4de1-948a-dc065394d8de {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5645cde5-8876-4de1-948a-dc065394d8de" returned: 0 in 0.181s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Lock "cinder-quobyte-5645cde5-8876-4de1-948a-dc065394d8de" released by "delete_volume" :: held 0.872s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:23:54 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Created reservations ['7a24716c-c724-4dff-b0f2-98cc44ef8326', '0458ba5c-9fcb-428b-932f-dfbf9730f34e', 'c5b3e354-6e16-410f-9308-7f14f5f35f01', '6f54c236-ed31-4d37-a669-28e725afe274'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:23:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:23:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:23:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:23:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:23:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:23:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:23:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.263s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:23:55 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:23:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Deleted volume successfully.
Sep 27 11:23:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45baf2c8-3780-4b21-8c3b-cc50ee614aa3 tempest-VolumesMetadataTest-1779490810 None] Lock "cinder-5645cde5-8876-4de1-948a-dc065394d8de-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:04 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Flow 'volume_create_manager' (a59e5107-8203-4f4a-86aa-27d713b1d06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc203bb-9ac0-49f0-8d09-a637f46d874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc203bb-9ac0-49f0-8d09-a637f46d874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1071203409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95748668-4e83-4913-90d0-85e3cfee5589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb2650e23a743dc9b9da9e6dddbcabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:24:04Z,use_quota=True,user_id='662344d823fd4d5db09b00553455be3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab71348-d394-40dd-b81d-ad92f3ac745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab71348-d394-40dd-b81d-ad92f3ac745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcca9bb5-3792-486f-8424-7e7cde900952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcca9bb5-3792-486f-8424-7e7cde900952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95748668-4e83-4913-90d0-85e3cfee5589', 'volume_name': 'volume-95748668-4e83-4913-90d0-85e3cfee5589', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cd2f5f-c809-4e8e-aebd-e389d3a16bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cd2f5f-c809-4e8e-aebd-e389d3a16bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a2e077-bb47-46ec-a704-16afda181f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:04 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Volume 95748668-4e83-4913-90d0-85e3cfee5589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95748668-4e83-4913-90d0-85e3cfee5589', 'volume_size': 1}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1071203409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95748668-4e83-4913-90d0-85e3cfee5589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb2650e23a743dc9b9da9e6dddbcabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:24:04Z,use_quota=True,user_id='662344d823fd4d5db09b00553455be3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Creating volume 95748668-4e83-4913-90d0-85e3cfee5589 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:24:04 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:24:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-95748668-4e83-4913-90d0-85e3cfee5589 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:05 devstack quobyte-client[84221]: System call of process 88756 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:05 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=20, name=volume-95748668-4e83-4913-90d0-85e3cfee5589, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:24:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-95748668-4e83-4913-90d0-85e3cfee5589 1073741824" returned: 0 in 0.607s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-95748668-4e83-4913-90d0-85e3cfee5589 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-95748668-4e83-4913-90d0-85e3cfee5589" returned: 0 in 0.139s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] <== create_volume: return (892ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:24:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a2e077-bb47-46ec-a704-16afda181f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95748668-4e83-4913-90d0-85e3cfee5589', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92efd19-fcb3-4435-a12b-1c07ceba9903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:06 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Volume volume-95748668-4e83-4913-90d0-85e3cfee5589 (95748668-4e83-4913-90d0-85e3cfee5589): created successfully
Sep 27 11:24:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92efd19-fcb3-4435-a12b-1c07ceba9903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Flow 'volume_create_manager' (a59e5107-8203-4f4a-86aa-27d713b1d06f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:24:06 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-83821587-2d64-4d20-ac17-f6160f482069 tempest-VolumesTransfersV355Test-101335489 None] Created volume successfully.
Sep 27 11:24:06 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=24,cinder:UPDATE=46,cinder:INSERT=7,cinder:DELETE=4 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:24:08 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ff7f030d-5e9f-472a-b937-a03ad1b830f5 tempest-VolumesTransfersV355Test-988471162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:08 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ff7f030d-5e9f-472a-b937-a03ad1b830f5 tempest-VolumesTransfersV355Test-988471162 None] Transfer volume completed successfully.
Sep 27 11:24:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Acquiring lock "cinder-95748668-4e83-4913-90d0-85e3cfee5589-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Lock "cinder-95748668-4e83-4913-90d0-85e3cfee5589-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:09 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Acquiring lock "cinder-quobyte-95748668-4e83-4913-90d0-85e3cfee5589" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Lock "cinder-quobyte-95748668-4e83-4913-90d0-85e3cfee5589" acquired by "delete_volume" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:09 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[651f6f03-d28f-40fe-977a-255fe4b8cd66]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:24:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-95748668-4e83-4913-90d0-85e3cfee5589 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-df90942e-5f51-4e9f-afbe-70249d353f58 tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-df90942e-5f51-4e9f-afbe-70249d353f58 tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-df90942e-5f51-4e9f-afbe-70249d353f58 tempest-TaggedBootDevicesTest-26589849 None] Terminate volume connection completed successfully.
Sep 27 11:24:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-df90942e-5f51-4e9f-afbe-70249d353f58 tempest-TaggedBootDevicesTest-26589849 None] Deleting attachment 2df27ea0-932f-4629-90d5-fcb31294a8b2. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:24:10 devstack quobyte-client[84221]: System call of process 88764 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-95748668-4e83-4913-90d0-85e3cfee5589" returned: 0 in 0.722s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-95748668-4e83-4913-90d0-85e3cfee5589 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-95748668-4e83-4913-90d0-85e3cfee5589" returned: 0 in 0.161s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Lock "cinder-quobyte-95748668-4e83-4913-90d0-85e3cfee5589" released by "delete_volume" :: held 1.115s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:11 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-3a3dc18a-7760-43ea-b20b-df658cabe21b tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:11 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-3a3dc18a-7760-43ea-b20b-df658cabe21b tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:11 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-3a3dc18a-7760-43ea-b20b-df658cabe21b tempest-TaggedBootDevicesTest-26589849 None] Terminate volume connection completed successfully.
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-3a3dc18a-7760-43ea-b20b-df658cabe21b tempest-TaggedBootDevicesTest-26589849 None] Deleting attachment 58cf9e6c-58f0-4058-b77c-1bd96d9915fc. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Created reservations ['420b4893-a789-44ec-a1a8-d234722515ce', '5baa365a-c713-49b8-898b-3cfce6bfafb0', '018d4e61-e7d8-430e-8848-c6710f704b98', 'e2b31759-8823-4c6f-93cf-a6081f260e60'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.109s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:11 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:24:11 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Deleted volume successfully.
Sep 27 11:24:11 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-922f6150-fcfe-4685-b737-bd41e475a740 tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d44a3a2-3ece-4616-9b67-a0e33e693ad3 tempest-VolumesTransfersV355Test-964597255 None] Lock "cinder-95748668-4e83-4913-90d0-85e3cfee5589-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-922f6150-fcfe-4685-b737-bd41e475a740 tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-922f6150-fcfe-4685-b737-bd41e475a740 tempest-TaggedBootDevicesTest-26589849 None] Terminate volume connection completed successfully.
Sep 27 11:24:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-f8444ee6-ddbe-4d90-8434-3fcbb4a814f0 req-922f6150-fcfe-4685-b737-bd41e475a740 tempest-TaggedBootDevicesTest-26589849 None] Deleting attachment 49bd29dc-e4cf-4958-9c6b-b7a39d67217c. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:24:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:12 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:24:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Flow 'volume_create_manager' (8619b161-e6d3-46c9-ad9d-867b98535fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:24:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b15f8e9-3b15-45aa-85ee-0652578d7d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b15f8e9-3b15-45aa-85ee-0652578d7d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2088215263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f3a8ee-ec91-4143-978f-d21980a3f26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb2650e23a743dc9b9da9e6dddbcabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:24:13Z,use_quota=True,user_id='662344d823fd4d5db09b00553455be3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97aee61-9ebd-4d06-811f-7a4d41cd3a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97aee61-9ebd-4d06-811f-7a4d41cd3a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddda9a4b-c36d-4c66-8d4e-e657d8566398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddda9a4b-c36d-4c66-8d4e-e657d8566398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f3a8ee-ec91-4143-978f-d21980a3f26a', 'volume_name': 'volume-32f3a8ee-ec91-4143-978f-d21980a3f26a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7376a10-781e-49dd-9539-c154752e8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7376a10-781e-49dd-9539-c154752e8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ae5010-ddff-4795-9939-a10551ff4d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:13 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Volume 32f3a8ee-ec91-4143-978f-d21980a3f26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f3a8ee-ec91-4143-978f-d21980a3f26a', 'volume_size': 1}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2088215263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f3a8ee-ec91-4143-978f-d21980a3f26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb2650e23a743dc9b9da9e6dddbcabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:24:13Z,use_quota=True,user_id='662344d823fd4d5db09b00553455be3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Creating volume 32f3a8ee-ec91-4143-978f-d21980a3f26a {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:24:13 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-32f3a8ee-ec91-4143-978f-d21980a3f26a 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:13 devstack quobyte-client[84221]: System call of process 88771 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:13 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=21, name=volume-32f3a8ee-ec91-4143-978f-d21980a3f26a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-32f3a8ee-ec91-4143-978f-d21980a3f26a 1073741824" returned: 0 in 0.457s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-32f3a8ee-ec91-4143-978f-d21980a3f26a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-32f3a8ee-ec91-4143-978f-d21980a3f26a" returned: 0 in 0.120s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] <== create_volume: return (646ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ae5010-ddff-4795-9939-a10551ff4d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f3a8ee-ec91-4143-978f-d21980a3f26a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5087e96-36e0-4305-84f5-25276c166753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:14 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Volume volume-32f3a8ee-ec91-4143-978f-d21980a3f26a (32f3a8ee-ec91-4143-978f-d21980a3f26a): created successfully
Sep 27 11:24:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5087e96-36e0-4305-84f5-25276c166753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Flow 'volume_create_manager' (8619b161-e6d3-46c9-ad9d-867b98535fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:24:14 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-182bc0fb-e339-425b-ba22-f46dc95b17db tempest-VolumesTransfersV355Test-101335489 None] Created volume successfully.
Sep 27 11:24:15 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Acquiring lock "cinder-32f3a8ee-ec91-4143-978f-d21980a3f26a-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:15 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Lock "cinder-32f3a8ee-ec91-4143-978f-d21980a3f26a-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:15 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:15 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Acquiring lock "cinder-quobyte-32f3a8ee-ec91-4143-978f-d21980a3f26a" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:15 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Lock "cinder-quobyte-32f3a8ee-ec91-4143-978f-d21980a3f26a" acquired by "delete_volume" :: waited 0.021s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:15 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bc79a5-f1f3-447f-9b52-6d4342f06597]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:24:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-32f3a8ee-ec91-4143-978f-d21980a3f26a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:16 devstack quobyte-client[84221]: System call of process 88775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-32f3a8ee-ec91-4143-978f-d21980a3f26a" returned: 0 in 0.574s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-32f3a8ee-ec91-4143-978f-d21980a3f26a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-32f3a8ee-ec91-4143-978f-d21980a3f26a" returned: 0 in 0.143s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Lock "cinder-quobyte-32f3a8ee-ec91-4143-978f-d21980a3f26a" released by "delete_volume" :: held 0.978s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:17 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Created reservations ['9f008d4c-adb9-4389-b995-81f79ad0035e', '6bd922b6-e439-452d-bffb-409d48df82fd', 'a16d45a5-5b94-4f32-9ae3-64926f2625d7', 'e14b5b29-67b0-464a-ab5d-284c967bf06f'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:24:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.145s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:17 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:24:17 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Deleted volume successfully.
Sep 27 11:24:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f03c8ada-6c61-4568-a3a1-5c5482ae1923 tempest-VolumesTransfersV355Test-964597255 None] Lock "cinder-32f3a8ee-ec91-4143-978f-d21980a3f26a-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "cinder-5268557a-e503-4616-94c8-b90bbab02303-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-5268557a-e503-4616-94c8-b90bbab02303-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "cinder-quobyte-5268557a-e503-4616-94c8-b90bbab02303" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-quobyte-5268557a-e503-4616-94c8-b90bbab02303" acquired by "delete_volume" :: waited 0.015s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:24 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e7eda-be92-40f3-a2f6-23e27dca6af8]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:24:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:25 devstack quobyte-client[84221]: System call of process 88783 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:25 devstack quobyte-client[84221]: System call of process 88783 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303" returned: 0 in 0.682s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5268557a-e503-4616-94c8-b90bbab02303" returned: 0 in 0.437s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-quobyte-5268557a-e503-4616-94c8-b90bbab02303" released by "delete_volume" :: held 1.513s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Created reservations ['9caa13ff-f101-489b-bbcb-e3b288464de5', '361c4880-fd16-4c27-90fa-7a1158051d98', 'ce081b5e-dc69-40b5-9c87-076eed3a5e48', '08f3809c-8ce3-4d2c-9105-a6058929e93d'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.153s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:26 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:24:26 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Deleted volume successfully.
Sep 27 11:24:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "cinder-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5f64b795-7aa1-4af8-8055-ac8388bccb4a tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-5268557a-e503-4616-94c8-b90bbab02303-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "cinder-quobyte-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-quobyte-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c" acquired by "delete_volume" :: waited 0.047s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f00b66a-3617-412d-8d32-5d0f04b87d43]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:24:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:28 devstack quobyte-client[84221]: System call of process 88820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:28 devstack quobyte-client[84221]: System call of process 88820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:28 devstack quobyte-client[84221]: System call of process 88820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c" returned: 0 in 0.946s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c" returned: 0 in 0.198s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-quobyte-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c" released by "delete_volume" :: held 1.319s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:29 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Created reservations ['9be1a259-e3a1-4c64-8725-60a28be50a17', '8c345608-fe1a-474f-a9fb-2b0ccf3cabf1', '182883ca-5fa4-410d-b4db-89658d3b0fbb', 'bf3c4ee7-8e87-4337-9efa-b7661a4b27d0'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:24:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.155s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:30 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:24:30 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Deleted volume successfully.
Sep 27 11:24:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2eac7b77-8082-4e42-a37f-ce290910ac82 tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-fa627cb7-e3c7-47a8-9d70-e241ad4e0e6c-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "cinder-81e444b6-43cd-4b85-babf-87b5991eef12-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-81e444b6-43cd-4b85-babf-87b5991eef12-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:31 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "cinder-quobyte-81e444b6-43cd-4b85-babf-87b5991eef12" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-quobyte-81e444b6-43cd-4b85-babf-87b5991eef12" acquired by "delete_volume" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:31 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32da201-74d1-4ea4-a009-9e1c174da3c5]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:24:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12" returned: 0 in 0.548s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:32 devstack quobyte-client[84221]: System call of process 88827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12" returned: 1 in 0.587s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:24:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-81e444b6-43cd-4b85-babf-87b5991eef12" returned: 0 in 0.161s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-quobyte-81e444b6-43cd-4b85-babf-87b5991eef12" released by "delete_volume" :: held 1.648s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:33 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Flow 'volume_create_manager' (037937d3-68aa-4c6e-8516-5bb1d6d6b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a78a42-b4a6-45ee-805d-49666644bb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a78a42-b4a6-45ee-805d-49666644bb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2095169740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13321733-3033-42e2-83a3-1cb696005cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490220104b174e689efdd871c16db754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:24:33Z,use_quota=True,user_id='a2f869635aa0459dbc161e68ad125417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e95a40-1085-430c-8b9c-24e7e8b0e043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e95a40-1085-430c-8b9c-24e7e8b0e043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54bbb70-856f-456c-8dff-06098e27fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54bbb70-856f-456c-8dff-06098e27fb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13321733-3033-42e2-83a3-1cb696005cff', 'volume_name': 'volume-13321733-3033-42e2-83a3-1cb696005cff', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5d6297-5781-4c7c-b033-ffd5aeab4d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5d6297-5781-4c7c-b033-ffd5aeab4d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4a76f6-c57b-4b8f-9f24-556d1233831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:33 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Volume 13321733-3033-42e2-83a3-1cb696005cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13321733-3033-42e2-83a3-1cb696005cff', 'volume_size': 1}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2095169740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13321733-3033-42e2-83a3-1cb696005cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490220104b174e689efdd871c16db754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:24:33Z,use_quota=True,user_id='a2f869635aa0459dbc161e68ad125417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Creating volume 13321733-3033-42e2-83a3-1cb696005cff {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:24:33 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-13321733-3033-42e2-83a3-1cb696005cff 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:33 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Created reservations ['aeb6b2cd-611a-4665-a133-444dd8d76995', '6d03c2be-c9af-47bc-b034-61cf2457e5f4', 'df0002ee-ada1-4215-bb90-f8bc7b84b3cc', 'e0bf1ab6-1982-40d2-873b-79ca85666c0c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:24:33 devstack quobyte-client[84221]: System call of process 88832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:33 devstack quobyte-client[84221]: System call of process 88832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:33 devstack quobyte-client[84221]: System call of process 88832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:33 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=22, name=volume-13321733-3033-42e2-83a3-1cb696005cff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-13321733-3033-42e2-83a3-1cb696005cff 1073741824" returned: 0 in 0.702s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-13321733-3033-42e2-83a3-1cb696005cff {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.479s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-13321733-3033-42e2-83a3-1cb696005cff" returned: 0 in 0.348s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] <== create_volume: return (1164ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:24:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:35 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Deleted volume successfully.
Sep 27 11:24:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4a76f6-c57b-4b8f-9f24-556d1233831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13321733-3033-42e2-83a3-1cb696005cff', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2cfd841-7da2-4daa-b2ea-c0f0f4fb7c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-637fe3c4-20fa-4a14-abac-a96e0665f869 tempest-TaggedBootDevicesTest-26589849 None] Lock "cinder-81e444b6-43cd-4b85-babf-87b5991eef12-delete_volume" released by "delete_volume" :: held 4.038s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:35 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Volume volume-13321733-3033-42e2-83a3-1cb696005cff (13321733-3033-42e2-83a3-1cb696005cff): created successfully
Sep 27 11:24:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2cfd841-7da2-4daa-b2ea-c0f0f4fb7c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Flow 'volume_create_manager' (037937d3-68aa-4c6e-8516-5bb1d6d6b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:24:35 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1da6c888-3dd4-4673-a5b2-24ea8800aadb tempest-VolumesTransfersV357Test-1351626987 None] Created volume successfully.
Sep 27 11:24:36 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-508454ba-a574-4c9c-89e1-6ff121775e7c tempest-VolumesTransfersV357Test-1705456410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:36 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-508454ba-a574-4c9c-89e1-6ff121775e7c tempest-VolumesTransfersV357Test-1705456410 None] Transfer volume completed successfully.
Sep 27 11:24:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Acquiring lock "cinder-13321733-3033-42e2-83a3-1cb696005cff-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Lock "cinder-13321733-3033-42e2-83a3-1cb696005cff-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:38 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Acquiring lock "cinder-quobyte-13321733-3033-42e2-83a3-1cb696005cff" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Lock "cinder-quobyte-13321733-3033-42e2-83a3-1cb696005cff" acquired by "delete_volume" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:38 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c3d420-3042-4f62-a8d5-12155e2983d6]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:24:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-13321733-3033-42e2-83a3-1cb696005cff {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:39 devstack quobyte-client[84221]: System call of process 88839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-13321733-3033-42e2-83a3-1cb696005cff" returned: 0 in 1.092s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-13321733-3033-42e2-83a3-1cb696005cff {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.504s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-13321733-3033-42e2-83a3-1cb696005cff" returned: 0 in 0.388s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:39 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Lock "cinder-quobyte-13321733-3033-42e2-83a3-1cb696005cff" released by "delete_volume" :: held 1.698s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:40 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Created reservations ['315fd6f1-1721-4517-af32-fa28ac13c338', '602301b8-a529-47d9-bc09-01b92fb237f0', '953095db-5683-4041-942a-0fad5922a853', 'ae734e42-dcdf-4844-a56d-d2c141d945cf'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:24:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.124s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:41 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:24:41 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Deleted volume successfully.
Sep 27 11:24:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39d31711-c0d8-4f8e-80de-e3b8e6b7138f tempest-VolumesTransfersV357Test-166359441 None] Lock "cinder-13321733-3033-42e2-83a3-1cb696005cff-delete_volume" released by "delete_volume" :: held 3.352s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:42 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Flow 'volume_create_manager' (09216705-2737-4b1d-ba57-749b66951e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b47d7d6-c862-44e8-a7bf-cbbea8e83591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b47d7d6-c862-44e8-a7bf-cbbea8e83591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1771974754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d52e532-6c3e-46f0-98df-e8ab0594087e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490220104b174e689efdd871c16db754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:24:42Z,use_quota=True,user_id='a2f869635aa0459dbc161e68ad125417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89051f77-bf7c-46b4-a3de-67a085cc1010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89051f77-bf7c-46b4-a3de-67a085cc1010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07ef8a7-039e-421b-9188-1324f5927490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07ef8a7-039e-421b-9188-1324f5927490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d52e532-6c3e-46f0-98df-e8ab0594087e', 'volume_name': 'volume-0d52e532-6c3e-46f0-98df-e8ab0594087e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856c1f37-e0f4-40d5-9b21-902f7ef51fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856c1f37-e0f4-40d5-9b21-902f7ef51fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbcc734-5b56-4d7f-b9bc-3e4ed39dab63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:42 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Volume 0d52e532-6c3e-46f0-98df-e8ab0594087e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d52e532-6c3e-46f0-98df-e8ab0594087e', 'volume_size': 1}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1771974754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d52e532-6c3e-46f0-98df-e8ab0594087e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490220104b174e689efdd871c16db754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:24:42Z,use_quota=True,user_id='a2f869635aa0459dbc161e68ad125417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Creating volume 0d52e532-6c3e-46f0-98df-e8ab0594087e {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:24:42 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:24:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d52e532-6c3e-46f0-98df-e8ab0594087e 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:43 devstack quobyte-client[84221]: System call of process 88848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:43 devstack quobyte-client[84221]: System call of process 88848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:43 devstack quobyte-client[84221]: System call of process 88848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:43 devstack quobyte-client[84221]: System call of process 88848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:43 devstack quobyte-client[84221]: System call of process 88848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:43 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=23, name=volume-0d52e532-6c3e-46f0-98df-e8ab0594087e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:24:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d52e532-6c3e-46f0-98df-e8ab0594087e 1073741824" returned: 0 in 0.572s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d52e532-6c3e-46f0-98df-e8ab0594087e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d52e532-6c3e-46f0-98df-e8ab0594087e" returned: 0 in 0.182s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] <== create_volume: return (849ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:24:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffbcc734-5b56-4d7f-b9bc-3e4ed39dab63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d52e532-6c3e-46f0-98df-e8ab0594087e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc388e5-0b8d-42d5-8576-5dd6712dd297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:24:43 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Volume volume-0d52e532-6c3e-46f0-98df-e8ab0594087e (0d52e532-6c3e-46f0-98df-e8ab0594087e): created successfully
Sep 27 11:24:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc388e5-0b8d-42d5-8576-5dd6712dd297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:24:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Flow 'volume_create_manager' (09216705-2737-4b1d-ba57-749b66951e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:24:44 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-329295a2-d40c-4ba3-928f-d4a93866e9ab tempest-VolumesTransfersV357Test-1351626987 None] Created volume successfully.
Sep 27 11:24:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Acquiring lock "cinder-0d52e532-6c3e-46f0-98df-e8ab0594087e-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Lock "cinder-0d52e532-6c3e-46f0-98df-e8ab0594087e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:24:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Acquiring lock "cinder-quobyte-0d52e532-6c3e-46f0-98df-e8ab0594087e" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:24:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Lock "cinder-quobyte-0d52e532-6c3e-46f0-98df-e8ab0594087e" acquired by "delete_volume" :: waited 0.031s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:24:45 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd38ae6-ddf5-4432-a49f-38263104144d]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:24:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d52e532-6c3e-46f0-98df-e8ab0594087e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:46 devstack quobyte-client[84221]: System call of process 88853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:46 devstack quobyte-client[84221]: System call of process 88853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:46 devstack quobyte-client[84221]: System call of process 88853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:24:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d52e532-6c3e-46f0-98df-e8ab0594087e" returned: 0 in 0.896s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d52e532-6c3e-46f0-98df-e8ab0594087e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d52e532-6c3e-46f0-98df-e8ab0594087e" returned: 0 in 0.152s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Lock "cinder-quobyte-0d52e532-6c3e-46f0-98df-e8ab0594087e" released by "delete_volume" :: held 1.275s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:47 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Created reservations ['9ccf1f5d-3436-4cfe-b849-34211a945c25', '4da74719-9dc6-45d7-9e84-e8302d4021c1', '04764617-9c24-4ccc-b135-328a9989df90', '0739e121-4cc5-4453-8fcc-09bed4ed26b5'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:24:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:24:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:24:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:24:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:24:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:24:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:24:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.122s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:24:47 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:24:47 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Deleted volume successfully.
Sep 27 11:24:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-21444c0f-eb3a-436b-938b-44aa94c55cf1 tempest-VolumesTransfersV357Test-166359441 None] Lock "cinder-0d52e532-6c3e-46f0-98df-e8ab0594087e-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:24:57 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=42,cinder:INSERT=14,cinder:UPDATE=53,cinder:DELETE=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:24:57 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=90,cinder:SELECT=52,cinder:INSERT=16,cinder:DELETE=9 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:25:18 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Flow 'volume_create_manager' (2d58f5e4-f803-4e5c-ace2-cccec68607a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56287d2-8fe1-4aba-b83a-5452114b498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56287d2-8fe1-4aba-b83a-5452114b498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-860225280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378e42d3-52ff-4d2c-8310-780d0176991f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3649530c77694c97a5d6684dec37838e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:25:18Z,use_quota=True,user_id='b6921e998740443ca476cb3c70f898af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08769fe7-eef6-4722-92d3-619777024177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08769fe7-eef6-4722-92d3-619777024177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29ec5b8-e1b0-4bfb-a69d-29336e8a4e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29ec5b8-e1b0-4bfb-a69d-29336e8a4e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378e42d3-52ff-4d2c-8310-780d0176991f', 'volume_name': 'volume-378e42d3-52ff-4d2c-8310-780d0176991f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439289b-dd36-4396-98c9-49e631659b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439289b-dd36-4396-98c9-49e631659b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ea57b4-1f2c-40a4-ad1c-3f6e84f07390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:25:18 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Volume 378e42d3-52ff-4d2c-8310-780d0176991f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378e42d3-52ff-4d2c-8310-780d0176991f', 'volume_size': 1}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-860225280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378e42d3-52ff-4d2c-8310-780d0176991f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3649530c77694c97a5d6684dec37838e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:25:18Z,use_quota=True,user_id='b6921e998740443ca476cb3c70f898af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Creating volume 378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:25:18 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:25:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:25:18 devstack quobyte-client[84221]: System call of process 89126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:25:18 devstack quobyte-client[84221]: System call of process 89126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:25:18 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=24, name=volume-378e42d3-52ff-4d2c-8310-780d0176991f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:25:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f 1073741824" returned: 0 in 0.814s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:25:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:25:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f" returned: 0 in 0.972s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:25:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] <== create_volume: return (1907ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:25:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:25:21 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ea57b4-1f2c-40a4-ad1c-3f6e84f07390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378e42d3-52ff-4d2c-8310-780d0176991f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:25:21 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbae5340-a767-408d-98b8-fc43058b057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:25:21 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Volume volume-378e42d3-52ff-4d2c-8310-780d0176991f (378e42d3-52ff-4d2c-8310-780d0176991f): created successfully
Sep 27 11:25:21 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbae5340-a767-408d-98b8-fc43058b057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:25:21 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Flow 'volume_create_manager' (2d58f5e4-f803-4e5c-ace2-cccec68607a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:25:21 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-73a198fb-a44c-4c6a-91ee-3e62ea6b1b94 tempest-VolumesActionsTest-17955605 None] Created volume successfully.
Sep 27 11:25:31 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:25:31 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:25:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:25:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:25:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:25:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:25:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:25:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:25:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:25:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.341s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:25:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:25:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:26:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fe3a7fde-bb5a-40ff-8282-46b6a0b12226 tempest-VolumesActionsTest-17955605 None] Acquiring lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f" by "attach_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:26:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fe3a7fde-bb5a-40ff-8282-46b6a0b12226 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f" acquired by "attach_volume" :: waited 0.049s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:26:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-fe3a7fde-bb5a-40ff-8282-46b6a0b12226 tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:26:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-fe3a7fde-bb5a-40ff-8282-46b6a0b12226 tempest-VolumesActionsTest-17955605 None] Attaching volume 378e42d3-52ff-4d2c-8310-780d0176991f to instance b33333bb-16e1-41f0-85e2-d49f3cb140ff at mountpoint /dev/vdb on host None.
Sep 27 11:26:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-fe3a7fde-bb5a-40ff-8282-46b6a0b12226 tempest-VolumesActionsTest-17955605 None] Attach volume completed successfully.
Sep 27 11:26:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fe3a7fde-bb5a-40ff-8282-46b6a0b12226 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f" released by "attach_volume" :: held 1.342s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:26:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a596dd63-c5d5-4eaf-addf-3abe241999c8 tempest-VolumesActionsTest-17955605 None] Acquiring lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f-detach_volume" by "detach_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:26:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a596dd63-c5d5-4eaf-addf-3abe241999c8 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:26:13 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a596dd63-c5d5-4eaf-addf-3abe241999c8 tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:26:13 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a596dd63-c5d5-4eaf-addf-3abe241999c8 tempest-VolumesActionsTest-17955605 None] Detaching volume 378e42d3-52ff-4d2c-8310-780d0176991f from instance b33333bb-16e1-41f0-85e2-d49f3cb140ff.
Sep 27 11:26:13 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a596dd63-c5d5-4eaf-addf-3abe241999c8 tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:26:14 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a596dd63-c5d5-4eaf-addf-3abe241999c8 tempest-VolumesActionsTest-17955605 None] Detach volume completed successfully.
Sep 27 11:26:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a596dd63-c5d5-4eaf-addf-3abe241999c8 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f-detach_volume" released by "detach_volume" :: held 0.357s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:26:24 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:INSERT=2,cinder:SELECT=7,cinder:UPDATE=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:26:24 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:26:56 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Flow 'volume_create_manager' (b7ed6948-eb6f-4ce7-a7c7-9ec168e65ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70c1c5b-0807-4b06-b66a-cccee1d538c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70c1c5b-0807-4b06-b66a-cccee1d538c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-715138871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8e8709-5a13-46a9-a933-f3507bea6ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3659cf69a04f4b97988ee510bf3cc8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:26:56Z,use_quota=True,user_id='5132d04e1ff54907b8aa4ace806c4a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34038e98-169a-4d78-8d2d-32cba632425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34038e98-169a-4d78-8d2d-32cba632425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ee0b6f-2291-49da-a84e-05d0737a55b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ee0b6f-2291-49da-a84e-05d0737a55b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8e8709-5a13-46a9-a933-f3507bea6ec4', 'volume_name': 'volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7064336a-38c3-44f0-962d-f23444ae686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7064336a-38c3-44f0-962d-f23444ae686b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f5b6b4-b2a6-49fc-892b-7399b63792ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:26:56 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume 0d8e8709-5a13-46a9-a933-f3507bea6ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4', 'volume_size': 1}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-715138871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8e8709-5a13-46a9-a933-f3507bea6ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3659cf69a04f4b97988ee510bf3cc8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:26:56Z,use_quota=True,user_id='5132d04e1ff54907b8aa4ace806c4a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Creating volume 0d8e8709-5a13-46a9-a933-f3507bea6ec4 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:26:56 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:26:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:26:57 devstack quobyte-client[84221]: System call of process 89739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:26:57 devstack quobyte-client[84221]: System call of process 89739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:26:57 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=25, name=volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:26:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4 1073741824" returned: 0 in 1.033s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:26:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:26:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4" returned: 0 in 0.417s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:26:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] <== create_volume: return (1666ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:26:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:26:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f5b6b4-b2a6-49fc-892b-7399b63792ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:26:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c902c6-7e53-49d5-a259-e154d71723af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:26:59 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4 (0d8e8709-5a13-46a9-a933-f3507bea6ec4): created successfully
Sep 27 11:26:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c902c6-7e53-49d5-a259-e154d71723af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:26:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Flow 'volume_create_manager' (b7ed6948-eb6f-4ce7-a7c7-9ec168e65ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:26:59 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-575512cb-2c0f-4626-aa59-6c0fef1c91f3 tempest-AttachVolumeShelveTestJSON-952316277 None] Created volume successfully.
Sep 27 11:27:09 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:27:09 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:27:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:27:12 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:27:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Flow 'volume_create_manager' (e33fcce9-fc1c-4016-afc2-8fc1b10371fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:27:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e4bab6-ae64-426e-a918-5894a2993e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e4bab6-ae64-426e-a918-5894a2993e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-65889777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439014a0-659b-44a8-9978-a5f86cdf239c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e14cb73d132463da550ab6cdce2376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:27:12Z,use_quota=True,user_id='b01148db19c04a75bced670aded8e45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b249cd-1abe-469d-ab73-188af0ce365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b249cd-1abe-469d-ab73-188af0ce365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a91c418-f4c6-4d26-b973-f99060684610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a91c418-f4c6-4d26-b973-f99060684610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '439014a0-659b-44a8-9978-a5f86cdf239c', 'volume_name': 'volume-439014a0-659b-44a8-9978-a5f86cdf239c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e340304-d42b-40a5-83b3-61fd965fd0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e340304-d42b-40a5-83b3-61fd965fd0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f965f1-da63-457d-ad54-876fd4442347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:13 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Volume 439014a0-659b-44a8-9978-a5f86cdf239c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-439014a0-659b-44a8-9978-a5f86cdf239c', 'volume_size': 1}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-65889777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439014a0-659b-44a8-9978-a5f86cdf239c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e14cb73d132463da550ab6cdce2376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:27:12Z,use_quota=True,user_id='b01148db19c04a75bced670aded8e45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Creating volume 439014a0-659b-44a8-9978-a5f86cdf239c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:27:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:27:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:27:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.159s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:27:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:27:14 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:27:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-439014a0-659b-44a8-9978-a5f86cdf239c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:14 devstack quobyte-client[84221]: System call of process 89914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:27:14 devstack quobyte-client[84221]: System call of process 89914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:27:14 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=26, name=volume-439014a0-659b-44a8-9978-a5f86cdf239c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:27:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-439014a0-659b-44a8-9978-a5f86cdf239c 1073741824" returned: 0 in 1.163s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-439014a0-659b-44a8-9978-a5f86cdf239c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-439014a0-659b-44a8-9978-a5f86cdf239c" returned: 0 in 0.850s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] <== create_volume: return (2788ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:27:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.890s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:27:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f965f1-da63-457d-ad54-876fd4442347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-439014a0-659b-44a8-9978-a5f86cdf239c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf10f56-1024-44e9-9e04-f445d71d559f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:18 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Volume volume-439014a0-659b-44a8-9978-a5f86cdf239c (439014a0-659b-44a8-9978-a5f86cdf239c): created successfully
Sep 27 11:27:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf10f56-1024-44e9-9e04-f445d71d559f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Flow 'volume_create_manager' (e33fcce9-fc1c-4016-afc2-8fc1b10371fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:27:18 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c4e5739e-570a-43e8-b8f6-7e91ab898b35 tempest-ServersNegativeTestJSON-1723148050 None] Created volume successfully.
Sep 27 11:27:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cadd77fb-6553-4585-9872-63259cb0b0f4 tempest-VolumesActionsTest-17955605 None] Acquiring lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f" by "attach_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:27:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cadd77fb-6553-4585-9872-63259cb0b0f4 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f" acquired by "attach_volume" :: waited 0.094s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:27:22 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-cadd77fb-6553-4585-9872-63259cb0b0f4 tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:27:22 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-cadd77fb-6553-4585-9872-63259cb0b0f4 tempest-VolumesActionsTest-17955605 None] Attaching volume 378e42d3-52ff-4d2c-8310-780d0176991f to instance ed6ae179-f9bf-4b95-b973-f8fe7a9e3aed at mountpoint /dev/vdb on host None.
Sep 27 11:27:22 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-cadd77fb-6553-4585-9872-63259cb0b0f4 tempest-VolumesActionsTest-17955605 None] Attach volume completed successfully.
Sep 27 11:27:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cadd77fb-6553-4585-9872-63259cb0b0f4 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f" released by "attach_volume" :: held 0.983s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:27:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fbf40657-0190-44e2-8c26-00275868eb57 tempest-VolumesActionsTest-17955605 None] Acquiring lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f-detach_volume" by "detach_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:27:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fbf40657-0190-44e2-8c26-00275868eb57 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:27:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-fbf40657-0190-44e2-8c26-00275868eb57 tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:27:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-fbf40657-0190-44e2-8c26-00275868eb57 tempest-VolumesActionsTest-17955605 None] Detaching volume 378e42d3-52ff-4d2c-8310-780d0176991f from instance ed6ae179-f9bf-4b95-b973-f8fe7a9e3aed.
Sep 27 11:27:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-fbf40657-0190-44e2-8c26-00275868eb57 tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:27:24 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-fbf40657-0190-44e2-8c26-00275868eb57 tempest-VolumesActionsTest-17955605 None] Detach volume completed successfully.
Sep 27 11:27:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fbf40657-0190-44e2-8c26-00275868eb57 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f-detach_volume" released by "detach_volume" :: held 0.200s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:27:25 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:27:25 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:27:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Flow 'volume_create_manager' (911a77af-fdc6-4f04-92db-84a1f182e45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:27:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a32598-d0d9-471e-aa2f-f15bf1a20472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a32598-d0d9-471e-aa2f-f15bf1a20472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1401405486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c835c625-aa4d-427b-bb57-7b59b33395a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e14cb73d132463da550ab6cdce2376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:27:25Z,use_quota=True,user_id='b01148db19c04a75bced670aded8e45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507afcb9-7c16-4fe3-b275-69727b3cd193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507afcb9-7c16-4fe3-b275-69727b3cd193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10741cbf-028d-4a84-a12b-9e413142b43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10741cbf-028d-4a84-a12b-9e413142b43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c835c625-aa4d-427b-bb57-7b59b33395a7', 'volume_name': 'volume-c835c625-aa4d-427b-bb57-7b59b33395a7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da27a97-1226-435c-99b2-c4954c90c71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da27a97-1226-435c-99b2-c4954c90c71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c39132-e4c6-4654-8fb0-ac38d4de7b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:26 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Volume c835c625-aa4d-427b-bb57-7b59b33395a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c835c625-aa4d-427b-bb57-7b59b33395a7', 'volume_size': 1}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1401405486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c835c625-aa4d-427b-bb57-7b59b33395a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e14cb73d132463da550ab6cdce2376a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:27:25Z,use_quota=True,user_id='b01148db19c04a75bced670aded8e45d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Creating volume c835c625-aa4d-427b-bb57-7b59b33395a7 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:27:26 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:27:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c835c625-aa4d-427b-bb57-7b59b33395a7 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:26 devstack quobyte-client[84221]: System call of process 89942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:27:26 devstack quobyte-client[84221]: System call of process 89942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:27:26 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=27, name=volume-c835c625-aa4d-427b-bb57-7b59b33395a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:27:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c835c625-aa4d-427b-bb57-7b59b33395a7 1073741824" returned: 0 in 1.979s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c835c625-aa4d-427b-bb57-7b59b33395a7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c835c625-aa4d-427b-bb57-7b59b33395a7" returned: 0 in 0.560s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] <== create_volume: return (2857ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:27:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.879s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:27:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c39132-e4c6-4654-8fb0-ac38d4de7b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c835c625-aa4d-427b-bb57-7b59b33395a7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4dc636-7323-48bf-8e23-edada0118b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:27:30 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Volume volume-c835c625-aa4d-427b-bb57-7b59b33395a7 (c835c625-aa4d-427b-bb57-7b59b33395a7): created successfully
Sep 27 11:27:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4dc636-7323-48bf-8e23-edada0118b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:27:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Flow 'volume_create_manager' (911a77af-fdc6-4f04-92db-84a1f182e45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:27:30 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1a226e4b-cc1a-467b-a7a3-9c76f17d50cf tempest-ServersNegativeTestJSON-1723148050 None] Created volume successfully.
Sep 27 11:27:32 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "cinder-c835c625-aa4d-427b-bb57-7b59b33395a7-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:27:32 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Lock "cinder-c835c625-aa4d-427b-bb57-7b59b33395a7-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:27:33 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:27:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "cinder-quobyte-c835c625-aa4d-427b-bb57-7b59b33395a7" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:27:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Lock "cinder-quobyte-c835c625-aa4d-427b-bb57-7b59b33395a7" acquired by "delete_volume" :: waited 0.013s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:27:33 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[6222694e-c05c-4d0e-9448-489d39d76b17]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:27:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c835c625-aa4d-427b-bb57-7b59b33395a7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:33 devstack quobyte-client[84221]: System call of process 90037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:27:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c835c625-aa4d-427b-bb57-7b59b33395a7" returned: 0 in 0.542s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c835c625-aa4d-427b-bb57-7b59b33395a7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c835c625-aa4d-427b-bb57-7b59b33395a7" returned: 0 in 0.133s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Lock "cinder-quobyte-c835c625-aa4d-427b-bb57-7b59b33395a7" released by "delete_volume" :: held 0.873s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Created reservations ['3d189ece-ab37-4b12-985b-4eb71e0d9fd5', '6ce966fc-ee69-431a-bdad-30ee8666ca7b', 'f009be4a-48f8-4c43-b090-57e46f1588c6', 'a97e19f5-e4d2-4908-9cd6-853ec14e0744'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.114s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:27:34 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Deleted volume successfully.
Sep 27 11:27:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-11c8bd99-99df-44f0-a66c-74caed85809f tempest-ServersNegativeTestJSON-1723148050 None] Lock "cinder-c835c625-aa4d-427b-bb57-7b59b33395a7-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:27:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "cinder-439014a0-659b-44a8-9978-a5f86cdf239c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:27:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Lock "cinder-439014a0-659b-44a8-9978-a5f86cdf239c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:27:35 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:27:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "cinder-quobyte-439014a0-659b-44a8-9978-a5f86cdf239c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:27:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Lock "cinder-quobyte-439014a0-659b-44a8-9978-a5f86cdf239c" acquired by "delete_volume" :: waited 0.047s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:27:35 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e24912-14f7-43f2-b5d1-79e0c4cf37c5]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:27:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-439014a0-659b-44a8-9978-a5f86cdf239c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-439014a0-659b-44a8-9978-a5f86cdf239c" returned: 0 in 1.425s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-439014a0-659b-44a8-9978-a5f86cdf239c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-439014a0-659b-44a8-9978-a5f86cdf239c" returned: 0 in 0.187s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Lock "cinder-quobyte-439014a0-659b-44a8-9978-a5f86cdf239c" released by "delete_volume" :: held 1.944s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:27:37 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Created reservations ['c047fa74-7578-4196-8c6d-0ccad5f4947e', 'b8f41e73-0563-46a8-b0cb-f944e5342555', 'ca41b20e-49ff-4d9f-bbe0-17c0a9145da6', '26474bcf-ee43-4ec4-8470-6c5aa36da8f6'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.134s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:27:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Deleted volume successfully.
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c9bbd9e0-745b-4572-8987-93a4b61c003b tempest-ServersNegativeTestJSON-1723148050 None] Lock "cinder-439014a0-659b-44a8-9978-a5f86cdf239c-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:27:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:39 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.764s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3956551-8aa5-4d54-af8e-57d8eabc17ac]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:27:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:40 devstack quobyte-client[84221]: System call of process 90049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:27:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f" returned: 0 in 0.719s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:40 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be4e40f-fb28-41e2-903c-df4f01e7d4fa]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:27:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:42 devstack quobyte-client[84221]: System call of process 90073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:27:42 devstack quobyte-client[84221]: System call of process 90073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:27:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f" returned: 0 in 1.397s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.31d66834-c001-4f27-9842-5d381976d328lrj5ya0y.img {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:48 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=34,cinder:SELECT=22,cinder:DELETE=2,cinder:INSERT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:27:49 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=17,cinder:UPDATE=13,cinder:INSERT=9,cinder:DELETE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:27:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-aa78e1e2-c5a0-4590-bace-1d8d71b67eb2 req-88b502d7-071a-43a6-bf95-7f8810b74903 tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:27:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.31d66834-c001-4f27-9842-5d381976d328lrj5ya0y.img" returned: 0 in 11.826s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:54 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c87998-8913-4491-9f06-31846e2b0583]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:27:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:27:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f" returned: 0 in 0.626s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:27:54 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f, size 1024.00 MB, duration 11.83 sec, destination /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.31d66834-c001-4f27-9842-5d381976d328lrj5ya0y.img {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:27:54 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Converted 1024.00 MB image at 86.56 MB/s
Sep 27 11:27:54 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] 31d66834-c001-4f27-9842-5d381976d328 was raw, no need to convert to raw {{(pid=84197) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 27 11:28:02 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:28:04 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:28:09 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Flow 'volume_create_manager' (cf469024-ce06-4ddd-9bd2-72e82e6f3fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5554da-cf12-400c-95d7-58b546ddce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5554da-cf12-400c-95d7-58b546ddce11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-274127043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca3615a-78a5-4823-a3b2-f750517d90ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb31b728a1214884a9349a50eba89168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:28:09Z,use_quota=True,user_id='540ceb556bb9495f95bd46ceba6f486c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9abd33-f505-42cc-ad2d-7eab79e8d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9abd33-f505-42cc-ad2d-7eab79e8d49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc68c56-4afc-4a54-8d55-a3ab252eaee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc68c56-4afc-4a54-8d55-a3ab252eaee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca3615a-78a5-4823-a3b2-f750517d90ef', 'volume_name': 'volume-3ca3615a-78a5-4823-a3b2-f750517d90ef', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ca0981-e0c8-48eb-bd1f-eacf02648d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ca0981-e0c8-48eb-bd1f-eacf02648d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b387726-310e-4ec1-9b6f-19d23e7b3414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:09 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Volume 3ca3615a-78a5-4823-a3b2-f750517d90ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca3615a-78a5-4823-a3b2-f750517d90ef', 'volume_size': 1}
Sep 27 11:28:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:19 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:28:19 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:28:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 51.851s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Uploaded volume to glance image-id: 31d66834-c001-4f27-9842-5d381976d328. {{(pid=84197) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 27 11:28:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-aa78e1e2-c5a0-4590-bace-1d8d71b67eb2 req-88b502d7-071a-43a6-bf95-7f8810b74903 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 39.292s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:31 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70fa7a4-ccba-46a0-a6e2-797506afaf57]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:28:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-aa78e1e2-c5a0-4590-bace-1d8d71b67eb2 req-88b502d7-071a-43a6-bf95-7f8810b74903 tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0d225e75-a50e-4d28-9a93-4789aed9b130 tempest-VolumesActionsTest-17955605 None] Copy volume to image completed successfully.
Sep 27 11:28:32 devstack quobyte-client[84221]: System call of process 90151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-aa78e1e2-c5a0-4590-bace-1d8d71b67eb2 req-88b502d7-071a-43a6-bf95-7f8810b74903 tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4" returned: 0 in 0.502s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-aa78e1e2-c5a0-4590-bace-1d8d71b67eb2 req-88b502d7-071a-43a6-bf95-7f8810b74903 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.579s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.936s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-274127043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca3615a-78a5-4823-a3b2-f750517d90ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb31b728a1214884a9349a50eba89168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:28:09Z,use_quota=True,user_id='540ceb556bb9495f95bd46ceba6f486c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Creating volume 3ca3615a-78a5-4823-a3b2-f750517d90ef {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:28:32 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3ca3615a-78a5-4823-a3b2-f750517d90ef 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:32 devstack quobyte-client[84221]: System call of process 90154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:32 devstack quobyte-client[84221]: System call of process 90154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:32 devstack quobyte-client[84221]: System call of process 90154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:32 devstack quobyte-client[84221]: System call of process 90154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:32 devstack quobyte-client[84221]: System call of process 90154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:32 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=28, name=volume-3ca3615a-78a5-4823-a3b2-f750517d90ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:28:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-aa78e1e2-c5a0-4590-bace-1d8d71b67eb2 req-88b502d7-071a-43a6-bf95-7f8810b74903 tempest-AttachVolumeShelveTestJSON-952316277 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '450f103d-fb04-4a90-8a5b-64d4565e0038', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:28:32 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-aa78e1e2-c5a0-4590-bace-1d8d71b67eb2 req-88b502d7-071a-43a6-bf95-7f8810b74903 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:28:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3ca3615a-78a5-4823-a3b2-f750517d90ef 1073741824" returned: 0 in 0.751s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3ca3615a-78a5-4823-a3b2-f750517d90ef {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3ca3615a-78a5-4823-a3b2-f750517d90ef" returned: 0 in 0.386s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] <== create_volume: return (1194ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:28:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-aa78e1e2-c5a0-4590-bace-1d8d71b67eb2 req-88b502d7-071a-43a6-bf95-7f8810b74903 tempest-AttachVolumeShelveTestJSON-952316277 None] attachment_update completed successfully.
Sep 27 11:28:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b387726-310e-4ec1-9b6f-19d23e7b3414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca3615a-78a5-4823-a3b2-f750517d90ef', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89548a9-eb87-48cb-a57d-41fd4187c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:33 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Volume volume-3ca3615a-78a5-4823-a3b2-f750517d90ef (3ca3615a-78a5-4823-a3b2-f750517d90ef): created successfully
Sep 27 11:28:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89548a9-eb87-48cb-a57d-41fd4187c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Flow 'volume_create_manager' (cf469024-ce06-4ddd-9bd2-72e82e6f3fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:28:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-40a1866f-561a-4364-84da-9d753add0b77 req-72d30c58-9b70-422e-923b-0e6409a311a5 tempest-VolumesGetTestJSON-256247266 None] Created volume successfully.
Sep 27 11:28:34 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:28:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:34 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e36fdce-1302-4641-ac29-6687f3ce4c7f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:28:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:34 devstack quobyte-client[84221]: System call of process 90191 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Acquiring lock "cinder-3ca3615a-78a5-4823-a3b2-f750517d90ef-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:28:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f" returned: 0 in 0.729s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Lock "cinder-3ca3615a-78a5-4823-a3b2-f750517d90ef-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:28:35 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd2bb8e-cd15-4ed6-a2d9-81cfe47b6461]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:28:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:35 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:28:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Acquiring lock "cinder-quobyte-3ca3615a-78a5-4823-a3b2-f750517d90ef" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:28:35 devstack quobyte-client[84221]: System call of process 90194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Lock "cinder-quobyte-3ca3615a-78a5-4823-a3b2-f750517d90ef" acquired by "delete_volume" :: waited 0.069s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:28:35 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f14d75-1374-486b-996f-33a45ec4af44]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:28:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3ca3615a-78a5-4823-a3b2-f750517d90ef {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f" returned: 0 in 0.657s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:35 devstack quobyte-client[84221]: System call of process 90198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:36 devstack quobyte-client[84221]: System call of process 90197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3ca3615a-78a5-4823-a3b2-f750517d90ef" returned: 0 in 1.147s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3ca3615a-78a5-4823-a3b2-f750517d90ef {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3ca3615a-78a5-4823-a3b2-f750517d90ef" returned: 0 in 0.430s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Lock "cinder-quobyte-3ca3615a-78a5-4823-a3b2-f750517d90ef" released by "delete_volume" :: held 2.075s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:28:38 devstack cinder-volume[84197]: DEBUG cinder.quota [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Created reservations ['5542bfe4-587c-4bba-bc4a-283c908555b5', '4837fea1-cd62-479f-87da-818a73d6876d', '401cc5e1-f8ee-47f8-936c-b74583a6be6c', '193bcfb4-2572-477d-8143-12e5d3bc6c21'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.196s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:28:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:28:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.188s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 1.618s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:40 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:28:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.894s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:41 devstack cinder-volume[84197]: DEBUG cinder.manager [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:28:41 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Deleted volume successfully.
Sep 27 11:28:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-ce7c66c1-d80d-41f7-9ee7-46ecf7848be9 req-816b6048-5498-4a25-9922-58367b5f0ba0 tempest-VolumesGetTestJSON-256247266 None] Lock "cinder-3ca3615a-78a5-4823-a3b2-f750517d90ef-delete_volume" released by "delete_volume" :: held 6.809s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:28:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img" returned: 0 in 7.867s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:43 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f3474-0563-4363-a4c8-9978c76c1552]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:28:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f" returned: 0 in 0.853s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:44 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f, size 1024.00 MB, duration 7.87 sec, destination /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:28:44 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Converted 1024.00 MB image at 130.10 MB/s
Sep 27 11:28:44 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] 9ad815a1-2a41-4ccf-8a4e-522f0bcdecad was raw, converting to qcow2 {{(pid=84197) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 27 11:28:44 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e11163-6d69-4761-b7b0-a78ef8853cd8]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:28:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img" returned: 0 in 0.468s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img" returned: 1 in 0.495s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:28:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img /opt/stack/data/cinder/conversion/vol_upload_62dyt8dv {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img /opt/stack/data/cinder/conversion/vol_upload_62dyt8dv" returned: 0 in 0.240s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:46 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Image conversion details: src /opt/stack/data/cinder/conversion/378e42d3-52ff-4d2c-8310-780d0176991f.temp_image.9ad815a1-2a41-4ccf-8a4e-522f0bcdecad7lw6jsb4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_62dyt8dv {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:28:46 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 27 11:28:46 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f74771-2b56-4801-b48f-48a407f3023f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:28:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_62dyt8dv {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_62dyt8dv" returned: 0 in 0.556s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:48 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Flow 'volume_create_manager' (cc78284c-07e2-4567-83e5-5cbdbf66e586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53711689-43bc-45e0-8949-7503048d29aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53711689-43bc-45e0-8949-7503048d29aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-686288720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f1f17e-5c33-4353-8bee-3aa653ff9e12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='427ec9abefb84cbeb508cc40f3c5f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:28:47Z,use_quota=True,user_id='50abd402953141ad8cda436b22c64e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74de57e-89b9-4457-a266-bd8177abaf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74de57e-89b9-4457-a266-bd8177abaf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1001f9-1830-47c2-bcc6-659203c74df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1001f9-1830-47c2-bcc6-659203c74df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f1f17e-5c33-4353-8bee-3aa653ff9e12', 'volume_name': 'volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a4fa5-a7a2-4321-bc91-e38ebb8b5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a4fa5-a7a2-4321-bc91-e38ebb8b5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e0b2e2-196e-4eb8-90f7-ad85d50a0839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:48 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Volume f2f1f17e-5c33-4353-8bee-3aa653ff9e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12', 'volume_size': 1}
Sep 27 11:28:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.647s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Uploaded volume to glance image-id: 9ad815a1-2a41-4ccf-8a4e-522f0bcdecad. {{(pid=84197) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-686288720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f1f17e-5c33-4353-8bee-3aa653ff9e12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='427ec9abefb84cbeb508cc40f3c5f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:28:47Z,use_quota=True,user_id='50abd402953141ad8cda436b22c64e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Creating volume f2f1f17e-5c33-4353-8bee-3aa653ff9e12 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:28:49 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:28:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:50 devstack quobyte-client[84221]: System call of process 90247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:50 devstack quobyte-client[84221]: System call of process 90247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:50 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=29, name=volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:28:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12 1073741824" returned: 0 in 0.720s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:50 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-195a4459-03e4-4727-a073-bbc4158e018e tempest-VolumesActionsTest-17955605 None] Copy volume to image completed successfully.
Sep 27 11:28:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12" returned: 0 in 0.350s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] <== create_volume: return (1125ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:28:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e0b2e2-196e-4eb8-90f7-ad85d50a0839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d2e935-8322-4983-93c5-85345a914277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:51 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Volume volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12 (f2f1f17e-5c33-4353-8bee-3aa653ff9e12): created successfully
Sep 27 11:28:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d2e935-8322-4983-93c5-85345a914277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Flow 'volume_create_manager' (cc78284c-07e2-4567-83e5-5cbdbf66e586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:28:51 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1296e046-7bba-440d-aac8-3daba14b79c6 tempest-VolumesTestJSON-1956461645 None] Created volume successfully.
Sep 27 11:28:52 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:28:52 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:28:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Flow 'volume_create_manager' (204fd2b5-f29c-41ed-967f-ddd80264c238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3bbd25-eadf-4673-9558-e6a16346205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Acquiring lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3bbd25-eadf-4673-9558-e6a16346205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1597424486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb55228b-4c5f-421e-9a29-00383ba8acb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='427ec9abefb84cbeb508cc40f3c5f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:28:53Z,use_quota=True,user_id='50abd402953141ad8cda436b22c64e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b38d08-d662-4d54-9578-432702f78cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b38d08-d662-4d54-9578-432702f78cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac15c2a-163b-4fbc-8bf3-fd0d0404a375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac15c2a-163b-4fbc-8bf3-fd0d0404a375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb55228b-4c5f-421e-9a29-00383ba8acb3', 'volume_name': 'volume-eb55228b-4c5f-421e-9a29-00383ba8acb3', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27f4e26-2535-427e-abc2-1ebdef04629f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27f4e26-2535-427e-abc2-1ebdef04629f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e569c19d-b681-4cec-9f2a-51af405454ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:53 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Volume eb55228b-4c5f-421e-9a29-00383ba8acb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb55228b-4c5f-421e-9a29-00383ba8acb3', 'volume_size': 1}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1597424486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb55228b-4c5f-421e-9a29-00383ba8acb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='427ec9abefb84cbeb508cc40f3c5f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:28:53Z,use_quota=True,user_id='50abd402953141ad8cda436b22c64e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Creating volume eb55228b-4c5f-421e-9a29-00383ba8acb3 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:28:53 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eb55228b-4c5f-421e-9a29-00383ba8acb3 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:53 devstack quobyte-client[84221]: System call of process 90264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:53 devstack quobyte-client[84221]: System call of process 90264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:53 devstack quobyte-client[84221]: System call of process 90264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:53 devstack quobyte-client[84221]: System call of process 90264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:53 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=30, name=volume-eb55228b-4c5f-421e-9a29-00383ba8acb3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f-delete_volume" acquired by "delete_volume" :: waited 0.398s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eb55228b-4c5f-421e-9a29-00383ba8acb3 1073741824" returned: 0 in 0.553s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eb55228b-4c5f-421e-9a29-00383ba8acb3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eb55228b-4c5f-421e-9a29-00383ba8acb3" returned: 0 in 0.302s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:54 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Acquiring lock "cinder-quobyte-378e42d3-52ff-4d2c-8310-780d0176991f" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] <== create_volume: return (990ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e569c19d-b681-4cec-9f2a-51af405454ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb55228b-4c5f-421e-9a29-00383ba8acb3', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604c741c-52e6-44ab-87ae-7771728a7944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Lock "cinder-quobyte-378e42d3-52ff-4d2c-8310-780d0176991f" acquired by "delete_volume" :: waited 0.225s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:28:54 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Volume volume-eb55228b-4c5f-421e-9a29-00383ba8acb3 (eb55228b-4c5f-421e-9a29-00383ba8acb3): created successfully
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604c741c-52e6-44ab-87ae-7771728a7944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Flow 'volume_create_manager' (204fd2b5-f29c-41ed-967f-ddd80264c238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b580c4b5-e372-418f-afe3-a1f9a69ccf93]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:28:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:54 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1dcc747c-38b4-4b7a-b1c6-8208d5578c8a tempest-VolumesTestJSON-1956461645 None] Created volume successfully.
Sep 27 11:28:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f" returned: 0 in 0.751s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-378e42d3-52ff-4d2c-8310-780d0176991f" returned: 0 in 0.169s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Lock "cinder-quobyte-378e42d3-52ff-4d2c-8310-780d0176991f" released by "delete_volume" :: held 1.215s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:28:55 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:28:55 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:28:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Flow 'volume_create_manager' (b81dec55-e63f-4195-a51b-a5187ea52c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:28:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ce2f09-f529-4dd9-8040-d44fd4ff0093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ce2f09-f529-4dd9-8040-d44fd4ff0093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1543593415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a0591e-795d-40fa-9202-8e706816503a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='427ec9abefb84cbeb508cc40f3c5f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:28:56Z,use_quota=True,user_id='50abd402953141ad8cda436b22c64e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70319251-5402-4cac-8b27-45579fa20fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70319251-5402-4cac-8b27-45579fa20fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c36328a-6086-4b07-b112-5aabc3a8064f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c36328a-6086-4b07-b112-5aabc3a8064f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a0591e-795d-40fa-9202-8e706816503a', 'volume_name': 'volume-a6a0591e-795d-40fa-9202-8e706816503a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb0e958-a2f9-47ef-900c-9c0b3a229039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb0e958-a2f9-47ef-900c-9c0b3a229039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848da3ec-3c8b-423b-8269-f9db0d408454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:56 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Volume a6a0591e-795d-40fa-9202-8e706816503a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a0591e-795d-40fa-9202-8e706816503a', 'volume_size': 1}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1543593415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a0591e-795d-40fa-9202-8e706816503a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='427ec9abefb84cbeb508cc40f3c5f6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:28:56Z,use_quota=True,user_id='50abd402953141ad8cda436b22c64e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Creating volume a6a0591e-795d-40fa-9202-8e706816503a {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:28:56 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a6a0591e-795d-40fa-9202-8e706816503a 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:56 devstack quobyte-client[84221]: System call of process 90283 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:28:56 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=31, name=volume-a6a0591e-795d-40fa-9202-8e706816503a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Created reservations ['d9c35768-155e-48b6-bac3-712993504f38', '3aaf7882-9ab5-4ce3-9115-0474c48fbb50', '7718b700-91b8-427f-b7a2-32dc57627a3c', '7b3c6b56-31c7-40a9-9662-f5ff9e3398ba'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a6a0591e-795d-40fa-9202-8e706816503a 1073741824" returned: 0 in 0.531s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a6a0591e-795d-40fa-9202-8e706816503a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a6a0591e-795d-40fa-9202-8e706816503a" returned: 0 in 0.152s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] <== create_volume: return (748ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848da3ec-3c8b-423b-8269-f9db0d408454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a0591e-795d-40fa-9202-8e706816503a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d2a338-df0c-4885-b29b-3a35e836a04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:28:57 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Volume volume-a6a0591e-795d-40fa-9202-8e706816503a (a6a0591e-795d-40fa-9202-8e706816503a): created successfully
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d2a338-df0c-4885-b29b-3a35e836a04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Flow 'volume_create_manager' (b81dec55-e63f-4195-a51b-a5187ea52c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:28:57 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8648bfb5-1cac-4835-918c-8385584374b4 tempest-VolumesTestJSON-1956461645 None] Created volume successfully.
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.327s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:28:57 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Deleted volume successfully.
Sep 27 11:28:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-63e4d1c4-1762-4097-9b31-937f2fe16107 tempest-VolumesActionsTest-17955605 None] Lock "cinder-378e42d3-52ff-4d2c-8310-780d0176991f-delete_volume" released by "delete_volume" :: held 4.361s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:28:59 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "cinder-a6a0591e-795d-40fa-9202-8e706816503a-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:28:59 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-a6a0591e-795d-40fa-9202-8e706816503a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:28:59 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:28:59 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "cinder-quobyte-a6a0591e-795d-40fa-9202-8e706816503a" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:28:59 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-quobyte-a6a0591e-795d-40fa-9202-8e706816503a" acquired by "delete_volume" :: waited 0.014s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:28:59 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd98544-9de4-4932-8f95-9d41834c5d82]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:28:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a6a0591e-795d-40fa-9202-8e706816503a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:00 devstack quobyte-client[84221]: System call of process 90288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:00 devstack quobyte-client[84221]: System call of process 90288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a6a0591e-795d-40fa-9202-8e706816503a" returned: 0 in 0.601s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a6a0591e-795d-40fa-9202-8e706816503a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a6a0591e-795d-40fa-9202-8e706816503a" returned: 0 in 0.174s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-quobyte-a6a0591e-795d-40fa-9202-8e706816503a" released by "delete_volume" :: held 1.072s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:00 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Created reservations ['af9794b6-39ec-4098-8216-c3035cdb09e5', '658a3f87-f5f6-4c68-ab78-33e00ceb61c7', 'fe091406-df1a-4cf1-a7ab-67c596950342', 'fb936331-d57b-4cea-b876-7d8f260d94b5'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:29:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:29:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:29:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.219s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:01 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:29:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "cinder-eb55228b-4c5f-421e-9a29-00383ba8acb3-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:29:02 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Deleted volume successfully.
Sep 27 11:29:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-eb55228b-4c5f-421e-9a29-00383ba8acb3-delete_volume" acquired by "delete_volume" :: waited 0.335s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:29:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8f3d3499-09e6-4bf8-b7a0-cd203765c086 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-a6a0591e-795d-40fa-9202-8e706816503a-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:02 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "cinder-quobyte-eb55228b-4c5f-421e-9a29-00383ba8acb3" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:29:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-quobyte-eb55228b-4c5f-421e-9a29-00383ba8acb3" acquired by "delete_volume" :: waited 0.023s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:29:02 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf1fce9-2afa-4c94-b71c-43d7955c4f95]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:29:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eb55228b-4c5f-421e-9a29-00383ba8acb3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:03 devstack quobyte-client[84221]: System call of process 90361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:03 devstack quobyte-client[84221]: System call of process 90361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eb55228b-4c5f-421e-9a29-00383ba8acb3" returned: 0 in 0.557s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eb55228b-4c5f-421e-9a29-00383ba8acb3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eb55228b-4c5f-421e-9a29-00383ba8acb3" returned: 0 in 0.187s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:03 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-quobyte-eb55228b-4c5f-421e-9a29-00383ba8acb3" released by "delete_volume" :: held 0.991s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:03 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Created reservations ['9f381df6-aaf1-4993-a6b8-7f72d1832e4d', '132ad7a7-3c3b-4e9a-add8-894063a67dfa', '92c30cdf-3a0b-4537-925b-0b969ec224b7', 'bdbe0d8d-4caf-405f-b1e5-287d99ff73b3'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "cinder-f2f1f17e-5c33-4353-8bee-3aa653ff9e12-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.372s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:29:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Deleted volume successfully.
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-f2f1f17e-5c33-4353-8bee-3aa653ff9e12-delete_volume" acquired by "delete_volume" :: waited 0.313s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-47058398-a4a0-4076-b969-f8cdc8775eb6 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-eb55228b-4c5f-421e-9a29-00383ba8acb3-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:04 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "cinder-quobyte-f2f1f17e-5c33-4353-8bee-3aa653ff9e12" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-quobyte-f2f1f17e-5c33-4353-8bee-3aa653ff9e12" acquired by "delete_volume" :: waited 0.024s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2068277c-6980-48e2-b090-e745371ffb87]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:29:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12" returned: 0 in 0.778s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f2f1f17e-5c33-4353-8bee-3aa653ff9e12" returned: 0 in 0.222s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-quobyte-f2f1f17e-5c33-4353-8bee-3aa653ff9e12" released by "delete_volume" :: held 1.313s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Created reservations ['83f19bd5-6b84-413d-8c79-40ef301c6706', '42ae43d1-260f-4ebd-9e2b-859ed8531d6a', '1f53d125-0916-4a5a-b1b6-294a2ad5e8c4', '72544b39-2418-4394-99ad-ed3751c5280b'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.134s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:07 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:29:07 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Deleted volume successfully.
Sep 27 11:29:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e49cdddf-48b0-4202-ac70-3f6ad1f29698 tempest-VolumesTestJSON-1956461645 None] Lock "cinder-f2f1f17e-5c33-4353-8bee-3aa653ff9e12-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Flow 'volume_create_manager' (02f67116-2ef6-4ce2-91a9-11a097ff0052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842a6cd5-1b56-4cb4-a97f-d115708f60b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842a6cd5-1b56-4cb4-a97f-d115708f60b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-510405910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0308886-9193-4e47-8c44-3af892048dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cb18fbb7fe41b984615075098041d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:29:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:29:12Z,use_quota=True,user_id='ae231d0f7bcd44b2a8190d9c13fe1c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e9475e-3b73-4951-99b4-393332bab88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e9475e-3b73-4951-99b4-393332bab88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9fb8b3-197f-4f6c-a13f-923ec9479351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9fb8b3-197f-4f6c-a13f-923ec9479351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0308886-9193-4e47-8c44-3af892048dc3', 'volume_name': 'volume-b0308886-9193-4e47-8c44-3af892048dc3', 'volume_size': 2}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85221af-7b6b-4437-8594-b0d5683231cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85221af-7b6b-4437-8594-b0d5683231cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc46712-c7c8-479d-8677-ed62cafedea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:13 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Volume b0308886-9193-4e47-8c44-3af892048dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0308886-9193-4e47-8c44-3af892048dc3', 'volume_size': 2}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-510405910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0308886-9193-4e47-8c44-3af892048dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cb18fbb7fe41b984615075098041d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:29:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:29:12Z,use_quota=True,user_id='ae231d0f7bcd44b2a8190d9c13fe1c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Creating volume b0308886-9193-4e47-8c44-3af892048dc3 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:29:13 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b0308886-9193-4e47-8c44-3af892048dc3 2147483648 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:13 devstack quobyte-client[84221]: System call of process 90766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:13 devstack quobyte-client[84221]: System call of process 90766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:13 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=32, name=volume-b0308886-9193-4e47-8c44-3af892048dc3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b0308886-9193-4e47-8c44-3af892048dc3 2147483648" returned: 0 in 0.760s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b0308886-9193-4e47-8c44-3af892048dc3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b0308886-9193-4e47-8c44-3af892048dc3" returned: 0 in 0.351s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] <== create_volume: return (1217ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:29:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc46712-c7c8-479d-8677-ed62cafedea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0308886-9193-4e47-8c44-3af892048dc3', 'volume_size': 2}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7cdea8-4ab0-46b0-a3b6-1d585c122724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:14 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Volume volume-b0308886-9193-4e47-8c44-3af892048dc3 (b0308886-9193-4e47-8c44-3af892048dc3): created successfully
Sep 27 11:29:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7cdea8-4ab0-46b0-a3b6-1d585c122724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Flow 'volume_create_manager' (02f67116-2ef6-4ce2-91a9-11a097ff0052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:29:14 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4086e89c-8e39-4157-bdbb-ea3f2b1735ad tempest-VolumesCloneNegativeTest-1443019528 None] Created volume successfully.
Sep 27 11:29:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Acquiring lock "cinder-b0308886-9193-4e47-8c44-3af892048dc3-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:29:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Lock "cinder-b0308886-9193-4e47-8c44-3af892048dc3-delete_volume" acquired by "delete_volume" :: waited 0.216s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:29:16 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Acquiring lock "cinder-quobyte-b0308886-9193-4e47-8c44-3af892048dc3" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:29:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Lock "cinder-quobyte-b0308886-9193-4e47-8c44-3af892048dc3" acquired by "delete_volume" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:29:16 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9da9a0-3d7f-4902-81c0-b9243c439824]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:29:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b0308886-9193-4e47-8c44-3af892048dc3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b0308886-9193-4e47-8c44-3af892048dc3" returned: 0 in 0.526s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b0308886-9193-4e47-8c44-3af892048dc3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b0308886-9193-4e47-8c44-3af892048dc3" returned: 0 in 0.096s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Lock "cinder-quobyte-b0308886-9193-4e47-8c44-3af892048dc3" released by "delete_volume" :: held 0.844s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Created reservations ['63957294-4687-49a9-89c4-de2e7bd05368', '14c97f54-95cc-4b82-abfd-8e0fb535732e', 'da7cdb60-3219-4fd8-a5ac-de481e3abaa7', '4310b885-ea88-4a6a-95f3-229b69c2ab4c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ecb1b6a6-1138-498f-863c-333499719c35 tempest-BackendsCapabilitiesAdminTestsJSON-1230624432 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84197) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 27 11:29:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.216s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:18 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:29:18 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Deleted volume successfully.
Sep 27 11:29:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c6998c-164a-4354-a09b-c46786bbfdf7 tempest-VolumesCloneNegativeTest-1443019528 None] Lock "cinder-b0308886-9193-4e47-8c44-3af892048dc3-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c4f1cd53-a8dd-4d65-b31c-86fb83a52987 tempest-BackendsCapabilitiesAdminTestsJSON-1230624432 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84197) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 27 11:29:26 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Flow 'volume_create_manager' (bab96a0c-147c-46d5-948f-5bd44da55e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d5bc16-f64d-4e77-9a59-1cacdd297cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d5bc16-f64d-4e77-9a59-1cacdd297cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2058738925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96754ab-f491-4e7c-96ef-6621b0cff757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da9b940870b41a88ad7f4faf6e0bfec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:29:26Z,use_quota=True,user_id='45839188bbd14ea886e3adf801ed5ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cefea0-874b-45f9-b053-b16ac9b6b8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cefea0-874b-45f9-b053-b16ac9b6b8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e12d7b3-52d7-4a4e-a739-fd582d4a3f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e12d7b3-52d7-4a4e-a739-fd582d4a3f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96754ab-f491-4e7c-96ef-6621b0cff757', 'volume_name': 'volume-f96754ab-f491-4e7c-96ef-6621b0cff757', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85ccc46-c27b-4e2d-89b1-f8a3a42bbb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85ccc46-c27b-4e2d-89b1-f8a3a42bbb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594362c5-fed9-48dd-800e-e1cf8bfbc7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:26 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Volume f96754ab-f491-4e7c-96ef-6621b0cff757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96754ab-f491-4e7c-96ef-6621b0cff757', 'volume_size': 1}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2058738925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96754ab-f491-4e7c-96ef-6621b0cff757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da9b940870b41a88ad7f4faf6e0bfec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:29:26Z,use_quota=True,user_id='45839188bbd14ea886e3adf801ed5ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Creating volume f96754ab-f491-4e7c-96ef-6621b0cff757 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:29:26 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:29:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f96754ab-f491-4e7c-96ef-6621b0cff757 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:26 devstack quobyte-client[84221]: System call of process 90810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:26 devstack quobyte-client[84221]: System call of process 90810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:26 devstack quobyte-client[84221]: System call of process 90810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:26 devstack quobyte-client[84221]: System call of process 90810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:26 devstack quobyte-client[84221]: System call of process 90810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:26 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=33, name=volume-f96754ab-f491-4e7c-96ef-6621b0cff757, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:29:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-078a2678-0806-498c-a161-5786028dcb18 tempest-GroupSnapshotsV319Test-2053842438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:27 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-078a2678-0806-498c-a161-5786028dcb18 tempest-GroupSnapshotsV319Test-2053842438 None] Group tempest-GroupSnapshotsV319Test-Group-659185666: creating
Sep 27 11:29:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f96754ab-f491-4e7c-96ef-6621b0cff757 1073741824" returned: 0 in 0.851s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f96754ab-f491-4e7c-96ef-6621b0cff757 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f96754ab-f491-4e7c-96ef-6621b0cff757" returned: 0 in 0.319s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] <== create_volume: return (1213ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:29:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:27 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-078a2678-0806-498c-a161-5786028dcb18 tempest-GroupSnapshotsV319Test-2053842438 None] Group tempest-GroupSnapshotsV319Test-Group-659185666: created successfully
Sep 27 11:29:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594362c5-fed9-48dd-800e-e1cf8bfbc7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96754ab-f491-4e7c-96ef-6621b0cff757', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13679471-1644-47eb-b327-8d9aecc61a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:28 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Volume volume-f96754ab-f491-4e7c-96ef-6621b0cff757 (f96754ab-f491-4e7c-96ef-6621b0cff757): created successfully
Sep 27 11:29:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13679471-1644-47eb-b327-8d9aecc61a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Flow 'volume_create_manager' (bab96a0c-147c-46d5-948f-5bd44da55e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:29:28 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-078a2678-0806-498c-a161-5786028dcb18 tempest-GroupSnapshotsV319Test-2053842438 None] Create group completed successfully.
Sep 27 11:29:28 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e30c45de-50cf-441e-9107-b939f6872be0 tempest-VolumesNegativeTest-67086488 None] Created volume successfully.
Sep 27 11:29:29 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Flow 'volume_create_manager' (6cccee68-ef0a-4b19-bb95-87f71647e2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18e5726-e83c-407e-91f4-83bd94f5e95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=71,cinder:SELECT=41,cinder:INSERT=11,cinder:DELETE=5 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18e5726-e83c-407e-91f4-83bd94f5e95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-202389042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=efde0f64-1972-41a0-8609-5a296ee0724a,host='devstack@QuobyteHD#QuobyteHD',id=1f8794e4-e5fe-4733-998f-a28ee601488c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1aa328c62d436eb84486be2ae5d3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:29:29Z,use_quota=True,user_id='9afa7ade7dc749ccbf0d88232fd6be78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd017e9c-fc3b-4b43-925d-307c69085f77),volume_type_id=fd017e9c-fc3b-4b43-925d-307c69085f77)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153c0ab3-9df8-4766-b379-816305ed1b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153c0ab3-9df8-4766-b379-816305ed1b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e23bc0-9a10-4ce7-8b51-1f0e9f773b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e23bc0-9a10-4ce7-8b51-1f0e9f773b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8794e4-e5fe-4733-998f-a28ee601488c', 'volume_name': 'volume-1f8794e4-e5fe-4733-998f-a28ee601488c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d868823-3daa-4775-b03f-394fad705f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d868823-3daa-4775-b03f-394fad705f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74b33e2-9f98-4c47-808e-9dd66ec2ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:29 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Volume 1f8794e4-e5fe-4733-998f-a28ee601488c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8794e4-e5fe-4733-998f-a28ee601488c', 'volume_size': 1}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=efde0f64-1972-41a0-8609-5a296ee0724a,created_at=2025-09-27T09:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-202389042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=efde0f64-1972-41a0-8609-5a296ee0724a,host='devstack@QuobyteHD#QuobyteHD',id=1f8794e4-e5fe-4733-998f-a28ee601488c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1aa328c62d436eb84486be2ae5d3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:29:29Z,use_quota=True,user_id='9afa7ade7dc749ccbf0d88232fd6be78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd017e9c-fc3b-4b43-925d-307c69085f77),volume_type_id=fd017e9c-fc3b-4b43-925d-307c69085f77)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Creating volume 1f8794e4-e5fe-4733-998f-a28ee601488c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:29:29 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:29 devstack quobyte-client[84221]: System call of process 90814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:29 devstack quobyte-client[84221]: System call of process 90814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:29 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=34, name=volume-1f8794e4-e5fe-4733-998f-a28ee601488c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c 1073741824" returned: 0 in 0.649s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c" returned: 0 in 0.120s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] <== create_volume: return (886ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:29:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:30 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=48,cinder:UPDATE=57,cinder:DELETE=7,cinder:INSERT=13 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:29:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74b33e2-9f98-4c47-808e-9dd66ec2ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8794e4-e5fe-4733-998f-a28ee601488c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16782dec-23e8-470a-b67d-7712f96bbebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:29:30 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Volume volume-1f8794e4-e5fe-4733-998f-a28ee601488c (1f8794e4-e5fe-4733-998f-a28ee601488c): created successfully
Sep 27 11:29:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16782dec-23e8-470a-b67d-7712f96bbebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:29:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Flow 'volume_create_manager' (6cccee68-ef0a-4b19-bb95-87f71647e2e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:29:30 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-642db520-ea60-4850-9418-ba6c2ad91636 tempest-GroupSnapshotsV319Test-2053842438 None] Created volume successfully.
Sep 27 11:29:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] GroupSnapshot a73e5644-eb76-4ceb-a52b-cf36e1c2392d: creating.
Sep 27 11:29:32 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Group snapshot a73e5644-eb76-4ceb-a52b-cf36e1c2392d: creating. {{(pid=84197) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 27 11:29:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Creating offline snapshot 82404d28-366b-49b2-b2e9-43f64367dc0c of volume 1f8794e4-e5fe-4733-998f-a28ee601488c {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:29:32 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32a93b2-beca-4bec-9a74-7c82150d402e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:29:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c" returned: 0 in 0.611s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:33 devstack quobyte-client[84221]: System call of process 90821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:33 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=35, name=volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:29:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c 1G" returned: 0 in 0.408s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f8794e4-e5fe-4733-998f-a28ee601488c -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:33 devstack quobyte-client[84221]: System call of process 90825 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] CMD "qemu-img rebase -u -b volume-1f8794e4-e5fe-4733-998f-a28ee601488c -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c" returned: 0 in 0.290s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:29:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c" returned: 0 in 0.121s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:29:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c" returned: 0 in 0.132s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.info" returned: 0 in 0.416s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:29:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.info" returned: 0 in 0.507s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.891s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:35 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b164cff2-e869-45ed-b7c4-b4c2ba9071db tempest-GroupSnapshotsV319Test-2053842438 None] group_snapshot a73e5644-eb76-4ceb-a52b-cf36e1c2392d: created successfully
Sep 27 11:29:37 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] group_snapshot a73e5644-eb76-4ceb-a52b-cf36e1c2392d: deleting
Sep 27 11:29:37 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] group_snapshot a73e5644-eb76-4ceb-a52b-cf36e1c2392d: deleting {{(pid=84197) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 27 11:29:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Acquiring lock "cinder-quobyte-1f8794e4-e5fe-4733-998f-a28ee601488c" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:29:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "cinder-quobyte-1f8794e4-e5fe-4733-998f-a28ee601488c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:29:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Acquiring lock "cinder-quobyte-82404d28-366b-49b2-b2e9-43f64367dc0c" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:29:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "cinder-quobyte-82404d28-366b-49b2-b2e9-43f64367dc0c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:29:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Deleting offline snapshot 82404d28-366b-49b2-b2e9-43f64367dc0c of volume 1f8794e4-e5fe-4733-998f-a28ee601488c {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:29:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] snapshot_file for this snap is: volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:29:38 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8029048-6ef3-4d0f-b13f-33d168e07929]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:29:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:39 devstack quobyte-client[84221]: System call of process 90864 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:39 devstack quobyte-client[84221]: System call of process 90864 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c" returned: 0 in 1.319s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8794e4-e5fe-4733-998f-a28ee601488c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.327s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18d2f09-e21b-4e26-910c-3e792691f86f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:29:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:40 devstack quobyte-client[84221]: System call of process 90872 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c" returned: 0 in 1.055s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:41 devstack quobyte-client[84221]: System call of process 90879 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c" returned: 0 in 0.683s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c.82404d28-366b-49b2-b2e9-43f64367dc0c" returned: 0 in 0.216s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "cinder-quobyte-82404d28-366b-49b2-b2e9-43f64367dc0c" released by "_delete_snapshot" :: held 4.059s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "cinder-quobyte-1f8794e4-e5fe-4733-998f-a28ee601488c" released by "delete_snapshot" :: held 4.110s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:42 devstack cinder-volume[84197]: WARNING cinder.quota [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2133072772 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2133072772, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:29:42 devstack cinder-volume[84197]: WARNING cinder.quota [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2133072772 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2133072772, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:29:42 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] Created reservations ['65990d73-886f-4e81-a855-3c4d70de9485', '7f067bf2-fcdb-4845-9d0a-1ba56f435271', 'c5ea4bbd-c638-4e14-9ca3-2ba8167b4c65', 'd7b1f24b-7af4-46e8-af69-e5b4d3028d46'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:29:43 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-cee21e38-7f0c-4112-936d-feb87e511849 tempest-GroupSnapshotsV319Test-2053842438 None] group_snapshot a73e5644-eb76-4ceb-a52b-cf36e1c2392d: deleted successfully
Sep 27 11:29:44 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:29:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Acquiring lock "cinder-quobyte-1f8794e4-e5fe-4733-998f-a28ee601488c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:29:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "cinder-quobyte-1f8794e4-e5fe-4733-998f-a28ee601488c" acquired by "delete_volume" :: waited 0.027s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:29:45 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94aa0a6-ea18-420c-a789-258a1bd2fd34]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:29:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:45 devstack quobyte-client[84221]: System call of process 90899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:29:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c" returned: 0 in 0.715s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f8794e4-e5fe-4733-998f-a28ee601488c" returned: 0 in 0.133s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "cinder-quobyte-1f8794e4-e5fe-4733-998f-a28ee601488c" released by "delete_volume" :: held 1.383s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:29:46 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Created reservations ['dec51872-091b-409c-affe-5ed6d259ef92'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:29:46 devstack cinder-volume[84197]: WARNING cinder.quota [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2133072772 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2133072772, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:29:46 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Created reservations ['03066b01-411a-4015-922c-80dd99b5f2a5', 'd59a5984-5773-49d4-a434-530977ac8c4c', 'bf241d7f-faba-4e7d-bbfb-59bcd6e181f0', '01b2b009-ef7c-416a-a5f1-da8f4b74e446'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:29:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:29:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:29:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:29:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:29:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:29:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:29:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.199s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:29:47 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:29:47 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-729ce4e9-3794-4cdf-8da1-ad83ac008ff3 tempest-GroupSnapshotsV319Test-2053842438 None] Delete group completed successfully.
Sep 27 11:29:57 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:29:57 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=16,cinder:DELETE=1,cinder:SELECT=22,cinder:INSERT=9 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:30:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b0d3e885-7526-4416-953f-0b253d930536 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b0d3e885-7526-4416-953f-0b253d930536 tempest-GroupsTest-1497565787 None] Group tempest-Group1-1552313771: creating
Sep 27 11:30:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b0d3e885-7526-4416-953f-0b253d930536 tempest-GroupsTest-1497565787 None] Group tempest-Group1-1552313771: created successfully
Sep 27 11:30:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b0d3e885-7526-4416-953f-0b253d930536 tempest-GroupsTest-1497565787 None] Create group completed successfully.
Sep 27 11:30:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-868f442e-22cc-4ade-9423-afbf33eb55d1 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-868f442e-22cc-4ade-9423-afbf33eb55d1 tempest-GroupsTest-1497565787 None] Group tempest-Group2-1255379718: creating
Sep 27 11:30:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-868f442e-22cc-4ade-9423-afbf33eb55d1 tempest-GroupsTest-1497565787 None] Group tempest-Group2-1255379718: created successfully
Sep 27 11:30:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-868f442e-22cc-4ade-9423-afbf33eb55d1 tempest-GroupsTest-1497565787 None] Create group completed successfully.
Sep 27 11:30:13 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:13 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:30:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Flow 'volume_create_manager' (f8b9776a-b84f-4599-ab7f-39ddafbbbf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80e6abf-4cff-4030-98ca-edb6780f1357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80e6abf-4cff-4030-98ca-edb6780f1357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-147324060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7f2ac959-cf89-4b23-a497-20f2f30305fc,host='devstack@QuobyteHD#QuobyteHD',id=024424d7-4238-437c-bb40-dd07b4e8c65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a780dd762c8447389af7654861cab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:14Z,use_quota=True,user_id='6a4c749423ae4c9fadcd5d584cfa1e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6073145e-9114-45a4-90c7-8eea23152dfc),volume_type_id=6073145e-9114-45a4-90c7-8eea23152dfc)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cc6ccc-9dd2-4995-bd33-6c3fc58d4305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cc6ccc-9dd2-4995-bd33-6c3fc58d4305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c54a8a6-56a6-4c01-acce-daa661ef1d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c54a8a6-56a6-4c01-acce-daa661ef1d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024424d7-4238-437c-bb40-dd07b4e8c65c', 'volume_name': 'volume-024424d7-4238-437c-bb40-dd07b4e8c65c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e0aabc-aac0-4021-b81e-5078aa65e26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e0aabc-aac0-4021-b81e-5078aa65e26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783d0b52-004e-47ca-a6fa-05c658b13e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:14 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Volume 024424d7-4238-437c-bb40-dd07b4e8c65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024424d7-4238-437c-bb40-dd07b4e8c65c', 'volume_size': 1}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7f2ac959-cf89-4b23-a497-20f2f30305fc,created_at=2025-09-27T09:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-147324060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7f2ac959-cf89-4b23-a497-20f2f30305fc,host='devstack@QuobyteHD#QuobyteHD',id=024424d7-4238-437c-bb40-dd07b4e8c65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a780dd762c8447389af7654861cab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:14Z,use_quota=True,user_id='6a4c749423ae4c9fadcd5d584cfa1e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6073145e-9114-45a4-90c7-8eea23152dfc),volume_type_id=6073145e-9114-45a4-90c7-8eea23152dfc)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Creating volume 024424d7-4238-437c-bb40-dd07b4e8c65c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:30:14 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-024424d7-4238-437c-bb40-dd07b4e8c65c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:14 devstack quobyte-client[84221]: System call of process 91072 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:14 devstack quobyte-client[84221]: System call of process 91072 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:14 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=37, name=volume-024424d7-4238-437c-bb40-dd07b4e8c65c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-024424d7-4238-437c-bb40-dd07b4e8c65c 1073741824" returned: 0 in 0.567s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-024424d7-4238-437c-bb40-dd07b4e8c65c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-024424d7-4238-437c-bb40-dd07b4e8c65c" returned: 0 in 0.282s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] <== create_volume: return (984ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:30:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783d0b52-004e-47ca-a6fa-05c658b13e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024424d7-4238-437c-bb40-dd07b4e8c65c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef6caa7-292b-402d-a63b-fcf199e6b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:15 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Volume volume-024424d7-4238-437c-bb40-dd07b4e8c65c (024424d7-4238-437c-bb40-dd07b4e8c65c): created successfully
Sep 27 11:30:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef6caa7-292b-402d-a63b-fcf199e6b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Flow 'volume_create_manager' (f8b9776a-b84f-4599-ab7f-39ddafbbbf68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:15 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-eb824307-c243-46fd-852c-06cf9825f2a6 tempest-GroupsTest-1497565787 None] Created volume successfully.
Sep 27 11:30:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Acquiring lock "cinder-quobyte-024424d7-4238-437c-bb40-dd07b4e8c65c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Lock "cinder-quobyte-024424d7-4238-437c-bb40-dd07b4e8c65c" acquired by "delete_volume" :: waited 0.063s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:17 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[443dc667-2c71-45d8-b4c4-570f700abf93]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-024424d7-4238-437c-bb40-dd07b4e8c65c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:18 devstack quobyte-client[84221]: System call of process 91077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:18 devstack quobyte-client[84221]: System call of process 91077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:18 devstack quobyte-client[84221]: System call of process 91077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-024424d7-4238-437c-bb40-dd07b4e8c65c" returned: 0 in 0.635s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-024424d7-4238-437c-bb40-dd07b4e8c65c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-024424d7-4238-437c-bb40-dd07b4e8c65c" returned: 0 in 0.132s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Lock "cinder-quobyte-024424d7-4238-437c-bb40-dd07b4e8c65c" released by "delete_volume" :: held 1.037s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:19 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Created reservations ['4429564b-aaad-4875-bcda-2b0bc0c4dce0'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:30:19 devstack cinder-volume[84197]: WARNING cinder.quota [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1113013434 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1113013434, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:30:19 devstack cinder-volume[84197]: WARNING cinder.quota [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1113013434 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1113013434, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:30:19 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Created reservations ['9dd98558-deb6-4a83-b02b-a12864785e4c', '4e231dd2-ec48-4001-a753-e8abc39c4121', '3891331f-a64d-426b-8ab7-e846be7a7f20', 'c8bced5e-6bb1-47d7-81fe-b4c9fc80b869'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:30:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.140s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:20 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:30:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1c3c22f1-e339-47eb-a756-c4e5ec536653 tempest-GroupsTest-1497565787 None] Delete group completed successfully.
Sep 27 11:30:21 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:21 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Created reservations ['40bf7b87-1d9d-434f-9414-008f6ef041e0'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:30:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:21 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:21 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.139s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:22 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:30:22 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-3c692e8d-0683-447d-84b7-ec801daf17d8 tempest-GroupsTest-1497565787 None] Delete group completed successfully.
Sep 27 11:30:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8253defe-f9d2-4cbe-bd04-04c4e96f0170 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8253defe-f9d2-4cbe-bd04-04c4e96f0170 tempest-GroupsTest-1497565787 None] Group tempest-GroupsTest-Group-404593444: creating
Sep 27 11:30:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8253defe-f9d2-4cbe-bd04-04c4e96f0170 tempest-GroupsTest-1497565787 None] Group tempest-GroupsTest-Group-404593444: created successfully
Sep 27 11:30:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8253defe-f9d2-4cbe-bd04-04c4e96f0170 tempest-GroupsTest-1497565787 None] Create group completed successfully.
Sep 27 11:30:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:24 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Flow 'volume_create_manager' (ab5dbb52-fa4c-4ff0-a0d8-8766e1f06d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41603460-ee32-47be-958e-e9e46ab9edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41603460-ee32-47be-958e-e9e46ab9edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2006593851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb4eebbb-1741-40f6-9a43-70bfcbb1c9cd,host='devstack@QuobyteHD#QuobyteHD',id=9e02475a-a6cc-4b36-97bb-f0ad5e4370c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a780dd762c8447389af7654861cab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:25Z,use_quota=True,user_id='6a4c749423ae4c9fadcd5d584cfa1e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4daacca9-8212-4697-9a09-1d91c701e951),volume_type_id=4daacca9-8212-4697-9a09-1d91c701e951)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d61c17-dc40-471e-82b0-01c0b3530bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d61c17-dc40-471e-82b0-01c0b3530bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0fa98b-df24-4c36-8394-f391a64ecf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0fa98b-df24-4c36-8394-f391a64ecf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e02475a-a6cc-4b36-97bb-f0ad5e4370c8', 'volume_name': 'volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a591cc8a-ad17-44c4-b5ab-a7d53d3a7806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a591cc8a-ad17-44c4-b5ab-a7d53d3a7806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbd6247-e237-4d3b-9612-46896aab6c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:25 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Volume 9e02475a-a6cc-4b36-97bb-f0ad5e4370c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8', 'volume_size': 1}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cb4eebbb-1741-40f6-9a43-70bfcbb1c9cd,created_at=2025-09-27T09:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2006593851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb4eebbb-1741-40f6-9a43-70bfcbb1c9cd,host='devstack@QuobyteHD#QuobyteHD',id=9e02475a-a6cc-4b36-97bb-f0ad5e4370c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a780dd762c8447389af7654861cab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:25Z,use_quota=True,user_id='6a4c749423ae4c9fadcd5d584cfa1e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4daacca9-8212-4697-9a09-1d91c701e951),volume_type_id=4daacca9-8212-4697-9a09-1d91c701e951)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Creating volume 9e02475a-a6cc-4b36-97bb-f0ad5e4370c8 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:30:25 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:25 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=38, name=volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8 1073741824" returned: 0 in 0.431s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8" returned: 0 in 0.159s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] <== create_volume: return (669ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:30:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbd6247-e237-4d3b-9612-46896aab6c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4994aad-d813-4e11-959e-a897ad877e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:26 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Volume volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8 (9e02475a-a6cc-4b36-97bb-f0ad5e4370c8): created successfully
Sep 27 11:30:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4994aad-d813-4e11-959e-a897ad877e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Flow 'volume_create_manager' (ab5dbb52-fa4c-4ff0-a0d8-8766e1f06d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:26 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f47f20ca-33d8-4ddd-98b1-a035f6d89422 tempest-GroupsTest-1497565787 None] Created volume successfully.
Sep 27 11:30:28 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Flow 'volume_create_manager' (625aa8b6-6add-4eef-974a-f762bb7aea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9537e4fd-f7ac-43f4-a418-0c1784c8efd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Acquiring lock "cinder-f96754ab-f491-4e7c-96ef-6621b0cff757-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9537e4fd-f7ac-43f4-a418-0c1784c8efd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1499478829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb4eebbb-1741-40f6-9a43-70bfcbb1c9cd,host='devstack@QuobyteHD#QuobyteHD',id=6a2d0077-6d19-4546-9182-4276371a18f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a780dd762c8447389af7654861cab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:28Z,use_quota=True,user_id='6a4c749423ae4c9fadcd5d584cfa1e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4daacca9-8212-4697-9a09-1d91c701e951),volume_type_id=4daacca9-8212-4697-9a09-1d91c701e951)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1a71bf-512c-452d-b263-85e29270b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1a71bf-512c-452d-b263-85e29270b355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457ba763-bf54-4b21-ade7-3208bceced52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457ba763-bf54-4b21-ade7-3208bceced52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2d0077-6d19-4546-9182-4276371a18f7', 'volume_name': 'volume-6a2d0077-6d19-4546-9182-4276371a18f7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c11bc44-5ff6-43bc-b5af-a622ae62dba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c11bc44-5ff6-43bc-b5af-a622ae62dba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880355a6-a85e-40e6-89d7-1346c6b2f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:28 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Volume 6a2d0077-6d19-4546-9182-4276371a18f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2d0077-6d19-4546-9182-4276371a18f7', 'volume_size': 1}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cb4eebbb-1741-40f6-9a43-70bfcbb1c9cd,created_at=2025-09-27T09:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1499478829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb4eebbb-1741-40f6-9a43-70bfcbb1c9cd,host='devstack@QuobyteHD#QuobyteHD',id=6a2d0077-6d19-4546-9182-4276371a18f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a780dd762c8447389af7654861cab29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:28Z,use_quota=True,user_id='6a4c749423ae4c9fadcd5d584cfa1e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4daacca9-8212-4697-9a09-1d91c701e951),volume_type_id=4daacca9-8212-4697-9a09-1d91c701e951)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Creating volume 6a2d0077-6d19-4546-9182-4276371a18f7 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:30:28 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6a2d0077-6d19-4546-9182-4276371a18f7 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:28 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=39, name=volume-6a2d0077-6d19-4546-9182-4276371a18f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Lock "cinder-f96754ab-f491-4e7c-96ef-6621b0cff757-delete_volume" acquired by "delete_volume" :: waited 0.325s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6a2d0077-6d19-4546-9182-4276371a18f7 1073741824" returned: 0 in 0.522s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6a2d0077-6d19-4546-9182-4276371a18f7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:29 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Acquiring lock "cinder-quobyte-f96754ab-f491-4e7c-96ef-6621b0cff757" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6a2d0077-6d19-4546-9182-4276371a18f7" returned: 0 in 0.427s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] <== create_volume: return (970ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Lock "cinder-quobyte-f96754ab-f491-4e7c-96ef-6621b0cff757" acquired by "delete_volume" :: waited 0.103s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880355a6-a85e-40e6-89d7-1346c6b2f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2d0077-6d19-4546-9182-4276371a18f7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8582921-f85d-458b-8eaf-f0751f969390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0359dc6c-67e6-418b-bef6-11e5c31f5c1b]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f96754ab-f491-4e7c-96ef-6621b0cff757 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:29 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Volume volume-6a2d0077-6d19-4546-9182-4276371a18f7 (6a2d0077-6d19-4546-9182-4276371a18f7): created successfully
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8582921-f85d-458b-8eaf-f0751f969390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Flow 'volume_create_manager' (625aa8b6-6add-4eef-974a-f762bb7aea79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:29 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-6d2a161f-b109-4d57-b198-31cc34c36f26 tempest-GroupsTest-1497565787 None] Created volume successfully.
Sep 27 11:30:29 devstack quobyte-client[84221]: System call of process 91103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:29 devstack quobyte-client[84221]: System call of process 91103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f96754ab-f491-4e7c-96ef-6621b0cff757" returned: 0 in 0.527s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f96754ab-f491-4e7c-96ef-6621b0cff757 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f96754ab-f491-4e7c-96ef-6621b0cff757" returned: 0 in 0.143s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Lock "cinder-quobyte-f96754ab-f491-4e7c-96ef-6621b0cff757" released by "delete_volume" :: held 0.893s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e1d11908-27f7-4a03-bc14-60cc4a7e40b8 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:30 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e1d11908-27f7-4a03-bc14-60cc4a7e40b8 tempest-GroupsTest-1497565787 None] Update group completed successfully.
Sep 27 11:30:30 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Created reservations ['608ee117-3504-43a9-af0d-7392dfb5161a', 'fa3b5a85-6372-41e0-834d-a4687cfb7b08', 'e9d2798e-57eb-4487-ba6f-b874e78d7838', '0e418cd1-10bf-4a66-8140-9b4e465ae91f'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:30:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.120s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:31 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:30:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Deleted volume successfully.
Sep 27 11:30:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-801c94ae-b1d3-420a-8953-ae74c6f95362 tempest-VolumesNegativeTest-67086488 None] Lock "cinder-f96754ab-f491-4e7c-96ef-6621b0cff757-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:31 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7b5c0b1d-89e0-4540-9944-daa5fb960272 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:32 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7b5c0b1d-89e0-4540-9944-daa5fb960272 tempest-GroupsTest-1497565787 None] Update group completed successfully.
Sep 27 11:30:33 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Acquiring lock "cinder-quobyte-6a2d0077-6d19-4546-9182-4276371a18f7" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Lock "cinder-quobyte-6a2d0077-6d19-4546-9182-4276371a18f7" acquired by "delete_volume" :: waited 0.032s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:33 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5dc305-bbdd-4f68-ba97-4db38983dc13]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6a2d0077-6d19-4546-9182-4276371a18f7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6a2d0077-6d19-4546-9182-4276371a18f7" returned: 0 in 0.566s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6a2d0077-6d19-4546-9182-4276371a18f7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6a2d0077-6d19-4546-9182-4276371a18f7" returned: 0 in 0.123s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Lock "cinder-quobyte-6a2d0077-6d19-4546-9182-4276371a18f7" released by "delete_volume" :: held 0.961s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Acquiring lock "cinder-quobyte-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Lock "cinder-quobyte-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8" acquired by "delete_volume" :: waited 0.200s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:34 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7411357-66cc-4600-a8d8-87dcc1a03064]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:35 devstack quobyte-client[84221]: System call of process 91113 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:35 devstack quobyte-client[84221]: System call of process 91113 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:35 devstack quobyte-client[84221]: System call of process 91113 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8" returned: 0 in 0.534s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8" returned: 0 in 0.132s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Lock "cinder-quobyte-9e02475a-a6cc-4b36-97bb-f0ad5e4370c8" released by "delete_volume" :: held 0.882s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:36 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Flow 'volume_create_manager' (06963aad-adc9-4af9-9881-5f0925c2d803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a65c884-7121-4695-9cbc-e5ed7f37328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a65c884-7121-4695-9cbc-e5ed7f37328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-987471920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83aa5c95faa453cad0d70bccefa11a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:36Z,use_quota=True,user_id='87079f3eea76468f9737c46144faf9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cb2303-4559-4df9-bef6-fe61a3e10e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cb2303-4559-4df9-bef6-fe61a3e10e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052a6628-42de-4aed-9075-50a1329a584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052a6628-42de-4aed-9075-50a1329a584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75', 'volume_name': 'volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75', 'volume_size': 2}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b206142-e9ff-4c94-a541-ec8729cd8cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b206142-e9ff-4c94-a541-ec8729cd8cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba71a30-06dc-4e50-961b-fbd43f986e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:36 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Volume e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75', 'volume_size': 2}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-987471920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a83aa5c95faa453cad0d70bccefa11a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:36Z,use_quota=True,user_id='87079f3eea76468f9737c46144faf9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Creating volume e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:30:36 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 2147483648 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:36 devstack quobyte-client[84221]: System call of process 91134 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:36 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=40, name=volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:30:36 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Created reservations ['ab470e60-88ff-4f6c-a034-ed6b7bf4839d'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:30:37 devstack cinder-volume[84197]: WARNING cinder.quota [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1059563597 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1059563597, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:30:37 devstack cinder-volume[84197]: WARNING cinder.quota [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1059563597 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1059563597, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Created reservations ['44c8ba65-7884-4247-9af9-60441fd5364c', '73fd9512-e4d8-4b5c-aa81-0315a0909ab2', '45a2d3a9-7d28-4d7d-ae68-3c33a287fe42', '12aa4c32-98f7-47d9-8a1c-bd1883a53f9c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 2147483648" returned: 0 in 0.936s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" returned: 0 in 0.309s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] <== create_volume: return (1287ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba71a30-06dc-4e50-961b-fbd43f986e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75', 'volume_size': 2}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f02f8b-c674-4694-a570-5c0bd18791c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:37 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Volume volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 (e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75): created successfully
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f02f8b-c674-4694-a570-5c0bd18791c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Flow 'volume_create_manager' (06963aad-adc9-4af9-9881-5f0925c2d803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:37 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1c4b5808-4a5e-4881-8d30-1edbed689ee7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Created volume successfully.
Sep 27 11:30:37 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Created reservations ['658d1db8-07ec-4dce-ac52-6bab4c1e42aa', '02c182b1-c012-4c1e-8d39-a9089566d768', '26de0de0-2014-44fc-a046-c1707f16cdfb', 'b44539eb-9c4c-4ffa-ba89-200453973be9'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:30:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.116s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:38 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:30:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a33ca17d-12f4-496d-99d0-ae409515e1f3 tempest-GroupsTest-1497565787 None] Delete group completed successfully.
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.138s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:30:39 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Creating offline snapshot d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 of volume e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aadcf59-c8ed-4aae-a89a-c72a7db6c058]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:40 devstack quobyte-client[84221]: System call of process 91155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:40 devstack quobyte-client[84221]: System call of process 91155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:40 devstack quobyte-client[84221]: System call of process 91155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" returned: 0 in 0.513s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 2G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:40 devstack quobyte-client[84221]: System call of process 91158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:40 devstack quobyte-client[84221]: System call of process 91158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:40 devstack quobyte-client[84221]: System call of process 91158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:40 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=41, name=volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:30:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 2G" returned: 0 in 0.386s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:40 devstack quobyte-client[84221]: System call of process 91161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "qemu-img rebase -u -b volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83" returned: 0 in 0.191s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83" returned: 0 in 0.164s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83" returned: 0 in 0.134s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.info" returned: 0 in 0.123s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.info" returned: 0 in 0.106s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:42 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-092c9ddf-8711-4c22-9340-337a40183780 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Create snapshot completed successfully
Sep 27 11:30:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Acquiring lock "cinder-d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:42 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Acquiring lock "cinder-quobyte-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-quobyte-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Acquiring lock "cinder-quobyte-d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-quobyte-d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Deleting offline snapshot d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 of volume e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:30:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] snapshot_file for this snap is: volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:30:43 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[5673b936-d9b4-4342-bbc4-0b6dca5d5c8e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:43 devstack quobyte-client[84221]: System call of process 91168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83" returned: 0 in 0.595s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:30:43 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[3951fbad-e09a-4920-a175-aca9a5b799e8]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:44 devstack quobyte-client[84221]: System call of process 91172 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" returned: 0 in 0.582s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:44 devstack quobyte-client[84221]: System call of process 91176 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:44 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-9f042ac2-ffca-409f-82ad-43938d357cd3 req-1b4cbcb0-8112-4a36-aaa8-0f1a52229a2f tempest-AttachVolumeShelveTestJSON-952316277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83" returned: 0 in 0.918s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-9f042ac2-ffca-409f-82ad-43938d357cd3 req-1b4cbcb0-8112-4a36-aaa8-0f1a52229a2f tempest-AttachVolumeShelveTestJSON-952316277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:45 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-9f042ac2-ffca-409f-82ad-43938d357cd3 req-1b4cbcb0-8112-4a36-aaa8-0f1a52229a2f tempest-AttachVolumeShelveTestJSON-952316277 None] Terminate volume connection completed successfully.
Sep 27 11:30:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-9f042ac2-ffca-409f-82ad-43938d357cd3 req-1b4cbcb0-8112-4a36-aaa8-0f1a52229a2f tempest-AttachVolumeShelveTestJSON-952316277 None] Deleting attachment 450f103d-fb04-4a90-8a5b-64d4565e0038. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:30:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75.d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83" returned: 0 in 0.312s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-quobyte-d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83" released by "_delete_snapshot" :: held 2.704s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-quobyte-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" released by "delete_snapshot" :: held 2.743s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:46 devstack cinder-volume[84197]: WARNING cinder.quota [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:30:46 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Created reservations ['1f6546ae-57ae-405f-92d4-96fbf26614cf', 'fb31cddd-35ac-43f7-bac6-192daf6a921f', '299acd35-a849-44c4-b8e3-9aa076b23724', 'a369623f-53cf-41fc-8d77-25525e93199b'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:30:46 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Delete snapshot completed successfully.
Sep 27 11:30:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1d7b60a9-ae28-4c18-b4aa-6b92ea1c40d7 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-d57c9705-ae0b-47f6-b1b9-8f9e62b0fa83-delete_snapshot" released by "delete_snapshot" :: held 3.502s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Acquiring lock "cinder-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75-delete_volume" acquired by "delete_volume" :: waited 0.142s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:47 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Flow 'volume_create_manager' (0100958c-6ef5-430e-8f6f-c0a59e854b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de7a718-47da-4e72-a49b-1617679ea74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de7a718-47da-4e72-a49b-1617679ea74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-256317477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efc8139-29e3-4aee-8f5e-d000fd065868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c58bf059d749429ef9d64de98acda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:47Z,use_quota=True,user_id='3d55c74d3e234d4280669a058cc43e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721ba0fb-d7ad-43a2-a8f1-6a5ead350dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721ba0fb-d7ad-43a2-a8f1-6a5ead350dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dad8e62-0cb6-4116-94e9-b5f7d27f591f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dad8e62-0cb6-4116-94e9-b5f7d27f591f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efc8139-29e3-4aee-8f5e-d000fd065868', 'volume_name': 'volume-4efc8139-29e3-4aee-8f5e-d000fd065868', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cb4ff8-19ee-4c5c-bd1e-3efcba426de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cb4ff8-19ee-4c5c-bd1e-3efcba426de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e2d691-b15f-4fd6-82cd-e14974d84ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:47 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Volume 4efc8139-29e3-4aee-8f5e-d000fd065868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efc8139-29e3-4aee-8f5e-d000fd065868', 'volume_size': 1}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-256317477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efc8139-29e3-4aee-8f5e-d000fd065868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c58bf059d749429ef9d64de98acda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:30:47Z,use_quota=True,user_id='3d55c74d3e234d4280669a058cc43e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Creating volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:30:47 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:30:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:48 devstack quobyte-client[84221]: System call of process 91204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:48 devstack quobyte-client[84221]: System call of process 91204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:48 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=43, name=volume-4efc8139-29e3-4aee-8f5e-d000fd065868, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:30:48 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Acquiring lock "cinder-quobyte-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:30:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 1073741824" returned: 0 in 0.634s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868" returned: 0 in 0.259s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-quobyte-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" acquired by "delete_volume" :: waited 0.371s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:30:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] <== create_volume: return (995ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:30:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:49 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c18b02f-6f22-4a32-aa25-054aff5e9337]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e2d691-b15f-4fd6-82cd-e14974d84ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efc8139-29e3-4aee-8f5e-d000fd065868', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e145a51-c086-44d8-8f1a-9ac97858d312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:30:49 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Volume volume-4efc8139-29e3-4aee-8f5e-d000fd065868 (4efc8139-29e3-4aee-8f5e-d000fd065868): created successfully
Sep 27 11:30:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e145a51-c086-44d8-8f1a-9ac97858d312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:30:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Flow 'volume_create_manager' (0100958c-6ef5-430e-8f6f-c0a59e854b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:30:49 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-d22c380c-5f28-4a4b-b0e6-a46ad378a00a tempest-SnapshotsActionsTest-799964130 None] Created volume successfully.
Sep 27 11:30:50 devstack quobyte-client[84221]: System call of process 91208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:50 devstack quobyte-client[84221]: System call of process 91208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:50 devstack quobyte-client[84221]: System call of process 91208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:50 devstack quobyte-client[84221]: System call of process 91208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" returned: 0 in 1.414s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" returned: 0 in 0.438s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-quobyte-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75" released by "delete_volume" :: held 2.570s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:51 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Creating offline snapshot 33c00c71-0a45-4b54-9e8a-64734dbe85e0 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:30:51 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dd5893-f57d-4c5f-907f-0bcf76c5322b]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Created reservations ['47f4a8c2-1c59-426b-8b0a-65a1c4578976', '8dcc0562-8f77-4f05-b675-77e3c8547005', '2e6cfec7-43fb-4888-9ac9-b6842d766dd5', '1bf8d8ed-cdb6-4d9b-9e6b-c4973e609bcc'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:30:52 devstack quobyte-client[84221]: System call of process 91251 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868" returned: 0 in 0.823s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.295s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:52 devstack quobyte-client[84221]: System call of process 91255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:52 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:30:53 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=44, name=volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:30:53 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Deleted volume successfully.
Sep 27 11:30:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 1G" returned: 0 in 0.732s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:53 devstack quobyte-client[84221]: System call of process 91259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:53 devstack quobyte-client[84221]: System call of process 91259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.556s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c637951-1930-4bf1-9a1e-9711514153c8 tempest-VolumesSnapshotNegativeTestJSON-551146821 None] Lock "cinder-e43e09c2-57fc-4e6c-8bcb-9c88bcd38b75-delete_volume" released by "delete_volume" :: held 6.461s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.263s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.194s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.info" returned: 0 in 0.192s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:30:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.info" returned: 0 in 0.133s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.523s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:30:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-324aad95-5a27-41b4-860c-73311481f028 tempest-SnapshotsActionsTest-799964130 None] Create snapshot completed successfully
Sep 27 11:30:57 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:30:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:30:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:30:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Creating offline snapshot 7b5f2975-deaf-422b-b691-213635f1ebb5 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:30:57 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7fbe8b-f000-4a3c-9612-61b27b1068cc]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:30:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.624s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:30:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:58 devstack quobyte-client[84221]: System call of process 91274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:58 devstack quobyte-client[84221]: System call of process 91274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:58 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=46, name=volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 1G" returned: 0 in 0.494s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:59 devstack quobyte-client[84221]: System call of process 91277 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5" returned: 0 in 0.251s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5" returned: 0 in 0.179s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5" returned: 0 in 0.130s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:30:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:00 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7e9c3a32-24fa-4b15-a0ab-15727aa17ab0 tempest-SnapshotsActionsTest-799964130 None] Create snapshot completed successfully
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-7b5f2975-deaf-422b-b691-213635f1ebb5-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-7b5f2975-deaf-422b-b691-213635f1ebb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:01 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-quobyte-7b5f2975-deaf-422b-b691-213635f1ebb5" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-7b5f2975-deaf-422b-b691-213635f1ebb5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Deleting offline snapshot 7b5f2975-deaf-422b-b691-213635f1ebb5 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] snapshot_file for this snap is: volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffff1e2-edd8-47ce-9dd0-dbe90d7d09e1]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:01 devstack quobyte-client[84221]: System call of process 91282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5" returned: 0 in 0.666s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:02 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f74b28-2b3e-4dbd-a7a4-2a36aa1b860a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.569s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:02 devstack quobyte-client[84221]: System call of process 91288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5" returned: 0 in 0.433s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.7b5f2975-deaf-422b-b691-213635f1ebb5" returned: 0 in 0.151s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:03 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-7b5f2975-deaf-422b-b691-213635f1ebb5" released by "_delete_snapshot" :: held 2.273s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:03 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" released by "delete_snapshot" :: held 2.304s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:03 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Created reservations ['fa834d6b-79a0-4f3e-aa59-1d0e93ef957a', '514a5f66-223c-412b-9d95-0f8d3408dfc1', 'e4a9242a-17ec-4bc8-9099-f20b60af714e', 'd35575bc-a9be-44c9-a6cb-c1ec73047bd9'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:31:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Delete snapshot completed successfully.
Sep 27 11:31:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-036cff3b-f02b-4080-9181-a25616c8f225 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-7b5f2975-deaf-422b-b691-213635f1ebb5-delete_snapshot" released by "delete_snapshot" :: held 2.872s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:05 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:31:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:31:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Creating offline snapshot 829fb584-bef8-4727-b941-fb5a8959fed5 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:31:05 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7adb87d-0971-4807-b0b4-ceecb0ac6192]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:06 devstack quobyte-client[84221]: System call of process 91299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:06 devstack quobyte-client[84221]: System call of process 91299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:06 devstack quobyte-client[84221]: System call of process 91299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:06 devstack quobyte-client[84221]: System call of process 91299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.549s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:06 devstack quobyte-client[84221]: System call of process 91302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:06 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=47, name=volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:31:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 1G" returned: 0 in 0.472s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:06 devstack quobyte-client[84221]: System call of process 91305 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:06 devstack quobyte-client[84221]: System call of process 91305 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5" returned: 0 in 0.369s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:31:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5" returned: 0 in 0.167s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:31:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5" returned: 0 in 0.193s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:07 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=72,cinder:SELECT=53,cinder:INSERT=17,cinder:DELETE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:31:08 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=83,cinder:UPDATE=83,cinder:DELETE=8,cinder:INSERT=14 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:31:08 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-513d039b-7973-450c-8499-3632abcbc721 tempest-SnapshotsActionsTest-799964130 None] Create snapshot completed successfully
Sep 27 11:31:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-829fb584-bef8-4727-b941-fb5a8959fed5-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-829fb584-bef8-4727-b941-fb5a8959fed5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:08 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-quobyte-829fb584-bef8-4727-b941-fb5a8959fed5" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-829fb584-bef8-4727-b941-fb5a8959fed5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Deleting offline snapshot 829fb584-bef8-4727-b941-fb5a8959fed5 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:31:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] snapshot_file for this snap is: volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:31:09 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e88818-ffc6-4181-b92c-254f85f2eb13]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:09 devstack quobyte-client[84221]: System call of process 91310 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5" returned: 0 in 0.647s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:09 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[792f2873-d643-46b6-895a-c1b58398b917]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:10 devstack quobyte-client[84221]: System call of process 91314 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.541s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:10 devstack quobyte-client[84221]: System call of process 91317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:10 devstack quobyte-client[84221]: System call of process 91317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5" returned: 0 in 0.290s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.829fb584-bef8-4727-b941-fb5a8959fed5" returned: 0 in 0.142s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-829fb584-bef8-4727-b941-fb5a8959fed5" released by "_delete_snapshot" :: held 2.020s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" released by "delete_snapshot" :: held 2.048s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:11 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Created reservations ['340400c4-91f5-4a7d-ad9a-3f12b15b4a70', '534d3c4b-d330-427e-9ff6-b78310321c06', 'ef1f0d04-1749-49cb-bfe8-95806e1b3b2a', '0c7db39f-e33d-4e2c-aac2-dca43e5917d4'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:31:11 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Delete snapshot completed successfully.
Sep 27 11:31:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d70ae067-5ed2-4753-ad1d-eccd55280631 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-829fb584-bef8-4727-b941-fb5a8959fed5-delete_snapshot" released by "delete_snapshot" :: held 2.661s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:31:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:31:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Creating offline snapshot ff412bd1-264b-479a-af0e-11de8c4bea44 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:31:12 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf75d53-0fe2-4bb3-993c-11d12a9771ae]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:13 devstack quobyte-client[84221]: System call of process 91321 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.554s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:13 devstack quobyte-client[84221]: System call of process 91324 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:13 devstack quobyte-client[84221]: System call of process 91324 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:13 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=48, name=volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 1G" returned: 0 in 0.465s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:14 devstack quobyte-client[84221]: System call of process 91328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:14 devstack quobyte-client[84221]: System call of process 91328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44" returned: 0 in 0.213s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44" returned: 0 in 0.138s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44" returned: 0 in 0.149s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:15 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-209aa1e2-80e9-495d-9db3-f1944beac340 tempest-SnapshotsActionsTest-799964130 None] Create snapshot completed successfully
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-ff412bd1-264b-479a-af0e-11de8c4bea44-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-ff412bd1-264b-479a-af0e-11de8c4bea44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.157s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:16 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-quobyte-ff412bd1-264b-479a-af0e-11de8c4bea44" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-ff412bd1-264b-479a-af0e-11de8c4bea44" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Deleting offline snapshot ff412bd1-264b-479a-af0e-11de8c4bea44 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] snapshot_file for this snap is: volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a869e85-dc7c-4fac-8229-9a551669fbd7]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44" returned: 0 in 0.958s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:17 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1100e424-307d-4a9a-9776-984a854ac805]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:18 devstack quobyte-client[84221]: System call of process 91340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 1.058s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:19 devstack quobyte-client[84221]: System call of process 91350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:19 devstack quobyte-client[84221]: System call of process 91350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:19 devstack quobyte-client[84221]: System call of process 91350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44" returned: 0 in 0.585s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.ff412bd1-264b-479a-af0e-11de8c4bea44" returned: 0 in 0.229s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-ff412bd1-264b-479a-af0e-11de8c4bea44" released by "_delete_snapshot" :: held 3.622s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" released by "delete_snapshot" :: held 3.685s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:20 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Created reservations ['8e72d84f-6009-4290-80f6-cd00db9e418a', 'eabb037e-9661-4a66-a24b-54dce7e827e6', '95c348d6-c6bb-4a46-96e4-1c788d65614d', 'e8e099d0-2793-4fed-b3ca-85f2c5e3530d'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:31:21 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Delete snapshot completed successfully.
Sep 27 11:31:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3c88cafc-9e2d-45fc-9132-17d716757dc0 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-ff412bd1-264b-479a-af0e-11de8c4bea44-delete_snapshot" released by "delete_snapshot" :: held 4.352s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:22 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:31:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:31:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Creating offline snapshot 2c916a65-58a1-41c6-be31-17276db97485 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:31:22 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e446ac10-d2b3-4825-bcb2-235d406601c5]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.633s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:23 devstack quobyte-client[84221]: System call of process 91363 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:23 devstack quobyte-client[84221]: System call of process 91363 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:23 devstack quobyte-client[84221]: System call of process 91363 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:23 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=49, name=volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:31:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 1G" returned: 0 in 0.477s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img rebase -u -b volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485" returned: 0 in 0.179s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:31:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485" returned: 0 in 0.170s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:31:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485" returned: 0 in 0.169s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:25 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e433c9f1-5043-4004-9212-1ebae0a4055b tempest-SnapshotsActionsTest-799964130 None] Create snapshot completed successfully
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-2c916a65-58a1-41c6-be31-17276db97485-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-2c916a65-58a1-41c6-be31-17276db97485-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:26 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Acquiring lock "cinder-quobyte-2c916a65-58a1-41c6-be31-17276db97485" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-2c916a65-58a1-41c6-be31-17276db97485" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Deleting offline snapshot 2c916a65-58a1-41c6-be31-17276db97485 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] snapshot_file for this snap is: volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[322e8202-1de1-4974-a692-cbfe0147d774]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485" returned: 0 in 0.809s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c82cc64-3f28-46a0-9e25-a5bc4183c405]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:28 devstack quobyte-client[84221]: System call of process 91385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:28 devstack quobyte-client[84221]: System call of process 91385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:28 devstack quobyte-client[84221]: System call of process 91385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:28 devstack quobyte-client[84221]: System call of process 91385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 1.067s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:28 devstack quobyte-client[84221]: System call of process 91396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:28 devstack quobyte-client[84221]: System call of process 91396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:28 devstack quobyte-client[84221]: System call of process 91396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:28 devstack quobyte-client[84221]: System call of process 91396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485" returned: 0 in 0.815s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.2c916a65-58a1-41c6-be31-17276db97485" returned: 0 in 0.500s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-2c916a65-58a1-41c6-be31-17276db97485" released by "_delete_snapshot" :: held 4.155s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" released by "delete_snapshot" :: held 4.260s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:31 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Created reservations ['5c9f660f-bb2e-4afc-bd3f-2b3fed38eb22', '61e00db0-ee6f-4aba-8697-74ec0110f7a9', '2b51a86e-178b-4769-a144-1fcf8b7bdadd', 'a359b6f5-5b2f-4756-96b0-b9c5f7050975'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:31:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Delete snapshot completed successfully.
Sep 27 11:31:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46fd0ccb-8d32-484d-8cf1-470c9f7759a2 tempest-SnapshotsActionsTest-217506633 None] Lock "cinder-2c916a65-58a1-41c6-be31-17276db97485-delete_snapshot" released by "delete_snapshot" :: held 5.884s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "cinder-33c00c71-0a45-4b54-9e8a-64734dbe85e0-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-33c00c71-0a45-4b54-9e8a-64734dbe85e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:34 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "cinder-quobyte-33c00c71-0a45-4b54-9e8a-64734dbe85e0" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-quobyte-33c00c71-0a45-4b54-9e8a-64734dbe85e0" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Deleting offline snapshot 33c00c71-0a45-4b54-9e8a-64734dbe85e0 of volume 4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] snapshot_file for this snap is: volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a32a173-b094-44eb-91b1-9d1d12f44304]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:36 devstack quobyte-client[84221]: System call of process 91456 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 1.552s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8139-29e3-4aee-8f5e-d000fd065868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:31:36 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b76627a-8394-495c-8915-d0c1391307f8]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868" returned: 0 in 0.662s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:37 devstack quobyte-client[84221]: System call of process 91469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:37 devstack quobyte-client[84221]: System call of process 91469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.646s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868.33c00c71-0a45-4b54-9e8a-64734dbe85e0" returned: 0 in 0.373s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-quobyte-33c00c71-0a45-4b54-9e8a-64734dbe85e0" released by "_delete_snapshot" :: held 4.466s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" released by "delete_snapshot" :: held 4.884s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.742s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:31:40 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Created reservations ['5b0357a8-ae85-4aa1-b7d0-156ddd02c8d5', '2d9fe5ae-6c82-4bbd-9237-1aaffcee2862', '498411bc-8a48-4c40-ab56-62e7662f9f2b', 'dbb036db-64b1-498e-810c-1aeaf3af8f04'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:31:40 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Delete snapshot completed successfully.
Sep 27 11:31:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-560ca62f-ba80-4b18-9c26-970a9596fd09 tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-33c00c71-0a45-4b54-9e8a-64734dbe85e0-delete_snapshot" released by "delete_snapshot" :: held 5.944s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "cinder-4efc8139-29e3-4aee-8f5e-d000fd065868-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-4efc8139-29e3-4aee-8f5e-d000fd065868-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:31:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" acquired by "delete_volume" :: waited 0.033s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:31:41 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf0dc0e-574b-46fc-9389-af631dea5890]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:42 devstack quobyte-client[84221]: System call of process 91507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:42 devstack quobyte-client[84221]: System call of process 91507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868" returned: 0 in 0.872s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4efc8139-29e3-4aee-8f5e-d000fd065868" returned: 0 in 0.253s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-quobyte-4efc8139-29e3-4aee-8f5e-d000fd065868" released by "delete_volume" :: held 1.349s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:43 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Created reservations ['86700d68-365a-42d3-9e60-1f74d923180b', 'fc21fc53-2dbb-4877-8926-abb4299fa1bf', '247c1869-613f-4859-8669-471417ee9583', '55d42770-92b0-469d-9a7c-47309ef712d8'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:31:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:31:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:31:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:31:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:31:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.140s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:44 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:31:44 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Deleted volume successfully.
Sep 27 11:31:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-42a0cb2a-efbc-49ee-8896-462a60a1fc3f tempest-SnapshotsActionsTest-799964130 None] Lock "cinder-4efc8139-29e3-4aee-8f5e-d000fd065868-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:31:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Flow 'volume_create_manager' (252aaf72-3198-465b-8d0f-e7f9ad63c587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5e99ef-5226-4b81-8823-89409a5f781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5e99ef-5226-4b81-8823-89409a5f781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-628435479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6928ac28-56f8-4fcf-8920-d615da97d768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0300f0dba8374bdc86b84a1c031406bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:31:45Z,use_quota=True,user_id='f6fcc812d82746f39cd73476a50a9010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13d61499-55d3-428d-a5ef-1e0248b6f39a),volume_type_id=13d61499-55d3-428d-a5ef-1e0248b6f39a)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703a25e6-70cf-4618-bb87-5f771bc33dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703a25e6-70cf-4618-bb87-5f771bc33dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d585f72-5972-4033-a785-3be7793ec03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d585f72-5972-4033-a785-3be7793ec03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6928ac28-56f8-4fcf-8920-d615da97d768', 'volume_name': 'volume-6928ac28-56f8-4fcf-8920-d615da97d768', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4188326c-1293-4700-856d-c8662c71ea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4188326c-1293-4700-856d-c8662c71ea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ece4731-d709-48f6-9bd6-3e873c26773e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume 6928ac28-56f8-4fcf-8920-d615da97d768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6928ac28-56f8-4fcf-8920-d615da97d768', 'volume_size': 1}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-628435479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6928ac28-56f8-4fcf-8920-d615da97d768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0300f0dba8374bdc86b84a1c031406bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:31:45Z,use_quota=True,user_id='f6fcc812d82746f39cd73476a50a9010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13d61499-55d3-428d-a5ef-1e0248b6f39a),volume_type_id=13d61499-55d3-428d-a5ef-1e0248b6f39a)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Creating volume 6928ac28-56f8-4fcf-8920-d615da97d768 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:31:45 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:31:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:46 devstack quobyte-client[84221]: System call of process 91516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:46 devstack quobyte-client[84221]: System call of process 91516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:46 devstack quobyte-client[84221]: System call of process 91516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:46 devstack quobyte-client[84221]: System call of process 91516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:46 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=50, name=volume-6928ac28-56f8-4fcf-8920-d615da97d768, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:31:48 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:48 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:31:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Flow 'volume_create_manager' (420867fa-f882-4a74-b109-18426f9fe4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:31:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3f3910-08c6-4ab6-8739-4d14ac2676f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3f3910-08c6-4ab6-8739-4d14ac2676f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2024844319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fee5502-5b13-4e84-8cc8-36fc88e5681f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0300f0dba8374bdc86b84a1c031406bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:31:46Z,use_quota=True,user_id='f6fcc812d82746f39cd73476a50a9010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23ff1ec0-a9cf-44fb-9c0d-2801f55aac1d),volume_type_id=23ff1ec0-a9cf-44fb-9c0d-2801f55aac1d)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80aafd4d-1298-4f54-b881-88206a8f3ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80aafd4d-1298-4f54-b881-88206a8f3ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e669fa-54ef-4307-b01b-e3efbd2c9610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e669fa-54ef-4307-b01b-e3efbd2c9610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fee5502-5b13-4e84-8cc8-36fc88e5681f', 'volume_name': 'volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c902a76-ca61-49c4-b12e-1481c498ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c902a76-ca61-49c4-b12e-1481c498ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f573a5b-330c-4765-9466-193b401d457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:49 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume 6fee5502-5b13-4e84-8cc8-36fc88e5681f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f', 'volume_size': 1}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768 1073741824" returned: 0 in 3.553s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:49 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:31:49 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Flow 'volume_create_manager' (e3dc83aa-b300-437e-8785-78cfbdd30f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ab7d29-b9ed-4a5c-b875-b3ab05eef5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ab7d29-b9ed-4a5c-b875-b3ab05eef5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1770966360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17165a91-d16d-47c4-beab-6b4a7dae2fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0300f0dba8374bdc86b84a1c031406bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:31:48Z,use_quota=True,user_id='f6fcc812d82746f39cd73476a50a9010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ced35728-73f1-4843-af94-c1e702335bfe),volume_type_id=ced35728-73f1-4843-af94-c1e702335bfe)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13600d85-d2c3-4cab-82c3-8bca5658b6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13600d85-d2c3-4cab-82c3-8bca5658b6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c126a1d-e508-4c21-ba22-142cb075e1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.image.glance [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Creating Keystone auth plugin from conf {{(pid=84197) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768" returned: 0 in 1.261s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] <== create_volume: return (4879ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.893s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2024844319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fee5502-5b13-4e84-8cc8-36fc88e5681f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0300f0dba8374bdc86b84a1c031406bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:31:46Z,use_quota=True,user_id='f6fcc812d82746f39cd73476a50a9010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23ff1ec0-a9cf-44fb-9c0d-2801f55aac1d),volume_type_id=23ff1ec0-a9cf-44fb-9c0d-2801f55aac1d)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Creating volume 6fee5502-5b13-4e84-8cc8-36fc88e5681f {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:31:50 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:31:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:50 devstack quobyte-client[84221]: System call of process 91526 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:31:51 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=51, name=volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:31:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ece4731-d709-48f6-9bd6-3e873c26773e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6928ac28-56f8-4fcf-8920-d615da97d768', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec9b5ac-4523-4e3f-864b-1847de41303f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f 1073741824" returned: 0 in 1.052s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:52 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume volume-6928ac28-56f8-4fcf-8920-d615da97d768 (6928ac28-56f8-4fcf-8920-d615da97d768): created successfully
Sep 27 11:31:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec9b5ac-4523-4e3f-864b-1847de41303f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Flow 'volume_create_manager' (252aaf72-3198-465b-8d0f-e7f9ad63c587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:31:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-3696db85-48a5-4a36-8173-f8905fb99490 tempest-TestInstancesWithCinderVolumes-471447094 None] Created volume successfully.
Sep 27 11:31:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f" returned: 0 in 0.795s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] <== create_volume: return (1935ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:31:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:31:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f573a5b-330c-4765-9466-193b401d457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b94656-a3ed-425a-a305-9fbcb87d2513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:52 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f (6fee5502-5b13-4e84-8cc8-36fc88e5681f): created successfully
Sep 27 11:31:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b94656-a3ed-425a-a305-9fbcb87d2513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Flow 'volume_create_manager' (420867fa-f882-4a74-b109-18426f9fe4f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:31:53 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e707c91e-557f-4f9b-93d3-3a54af607425 tempest-TestInstancesWithCinderVolumes-471447094 None] Created volume successfully.
Sep 27 11:31:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c126a1d-e508-4c21-ba22-142cb075e1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17165a91-d16d-47c4-beab-6b4a7dae2fad', 'volume_name': 'volume-17165a91-d16d-47c4-beab-6b4a7dae2fad', 'volume_size': 1, 'image_id': '7f30ac35-80cf-463f-b1b9-95327f4c670a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f30ac35-80cf-463f-b1b9-95327f4c670a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1456870866', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0300f0dba8374bdc86b84a1c031406bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f30ac35-80cf-463f-b1b9-95327f4c670a', 'created_at': datetime.datetime(2025, 9, 27, 9, 31, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 31, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f30ac35-80cf-463f-b1b9-95327f4c670a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d0a5ab0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d645df-c742-489d-a116-44f0e989a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d645df-c742-489d-a116-44f0e989a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:31:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdb042f-83d2-40fb-904e-1fd3626d7432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:31:53 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume 17165a91-d16d-47c4-beab-6b4a7dae2fad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17165a91-d16d-47c4-beab-6b4a7dae2fad', 'volume_size': 1, 'image_id': '7f30ac35-80cf-463f-b1b9-95327f4c670a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f30ac35-80cf-463f-b1b9-95327f4c670a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1456870866', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0300f0dba8374bdc86b84a1c031406bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f30ac35-80cf-463f-b1b9-95327f4c670a', 'created_at': datetime.datetime(2025, 9, 27, 9, 31, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 31, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f30ac35-80cf-463f-b1b9-95327f4c670a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d0a5ab0>}
Sep 27 11:31:53 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Cloning 17165a91-d16d-47c4-beab-6b4a7dae2fad from image 7f30ac35-80cf-463f-b1b9-95327f4c670a  at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f30ac35-80cf-463f-b1b9-95327f4c670a', 'metadata': {}}]). {{(pid=84197) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 27 11:31:56 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD, size 20.69 MB, duration 2.60 sec {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 27 11:31:56 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Image download 20.69 MB at 7.95 MB/s
Sep 27 11:31:56 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[add3e071-5d9a-4c91-a6d1-5c0e49175c2e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:31:56 devstack sudo[91533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD
Sep 27 11:31:56 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:31:59 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root
Sep 27 11:31:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD" returned: 0 in 3.176s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:31:59 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Temporary image 7f30ac35-80cf-463f-b1b9-95327f4c670a is fetched for user f6fcc812d82746f39cd73476a50a9010. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 27 11:31:59 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c44653-64fe-4784-ac5b-45f4b52259d6]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:31:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Flow 'volume_create_manager' (719b21f1-a2d6-4bad-8b38-a57fc207180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea55cb6-3298-4e80-8dc0-2313b602a212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea55cb6-3298-4e80-8dc0-2313b602a212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1077649655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4ad7e2-27dc-49df-a083-202cad23eebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fced0d7fc5842fc808d46f5540cbce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:00Z,use_quota=True,user_id='b8a8454605f24211abddd69bb02898a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:00 devstack sudo[91538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c57962a-cef0-403d-8cbd-a8170fe9268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:00 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c57962a-cef0-403d-8cbd-a8170fe9268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863d385d-c1aa-4508-abf4-6a7b0b20d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863d385d-c1aa-4508-abf4-6a7b0b20d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4ad7e2-27dc-49df-a083-202cad23eebf', 'volume_name': 'volume-4f4ad7e2-27dc-49df-a083-202cad23eebf', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5b1d9e-8889-4d6a-86b3-dba2941ddfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5b1d9e-8889-4d6a-86b3-dba2941ddfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01438772-8026-40c6-a2be-6d4530be65b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:00 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Volume 4f4ad7e2-27dc-49df-a083-202cad23eebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4ad7e2-27dc-49df-a083-202cad23eebf', 'volume_size': 1}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1077649655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4ad7e2-27dc-49df-a083-202cad23eebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fced0d7fc5842fc808d46f5540cbce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:00Z,use_quota=True,user_id='b8a8454605f24211abddd69bb02898a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Creating volume 4f4ad7e2-27dc-49df-a083-202cad23eebf {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:32:00 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:32:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4f4ad7e2-27dc-49df-a083-202cad23eebf 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:00 devstack quobyte-client[84221]: System call of process 91540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:00 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=52, name=volume-4f4ad7e2-27dc-49df-a083-202cad23eebf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:32:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4f4ad7e2-27dc-49df-a083-202cad23eebf 1073741824" returned: 0 in 0.559s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4f4ad7e2-27dc-49df-a083-202cad23eebf {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4f4ad7e2-27dc-49df-a083-202cad23eebf" returned: 0 in 0.158s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] <== create_volume: return (827ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:32:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01438772-8026-40c6-a2be-6d4530be65b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4ad7e2-27dc-49df-a083-202cad23eebf', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed197c29-180e-4f40-bef9-c6ab313a1d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:01 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Volume volume-4f4ad7e2-27dc-49df-a083-202cad23eebf (4f4ad7e2-27dc-49df-a083-202cad23eebf): created successfully
Sep 27 11:32:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed197c29-180e-4f40-bef9-c6ab313a1d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Flow 'volume_create_manager' (719b21f1-a2d6-4bad-8b38-a57fc207180f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:01 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1f350471-9ea3-456c-ad71-c73e17258097 tempest-VolumeQuotasAdminTestJSON-77781748 None] Created volume successfully.
Sep 27 11:32:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Acquiring lock "cinder-4f4ad7e2-27dc-49df-a083-202cad23eebf-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:32:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "cinder-4f4ad7e2-27dc-49df-a083-202cad23eebf-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:32:02 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Acquiring lock "cinder-quobyte-4f4ad7e2-27dc-49df-a083-202cad23eebf" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:32:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "cinder-quobyte-4f4ad7e2-27dc-49df-a083-202cad23eebf" acquired by "delete_volume" :: waited 0.030s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:32:02 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[550aaf1a-b931-42b5-bfdf-90035c71b621]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:32:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4f4ad7e2-27dc-49df-a083-202cad23eebf {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:03 devstack quobyte-client[84221]: System call of process 91548 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:03 devstack quobyte-client[84221]: System call of process 91548 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:03 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4f4ad7e2-27dc-49df-a083-202cad23eebf" returned: 0 in 0.790s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4f4ad7e2-27dc-49df-a083-202cad23eebf {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD" returned: 0 in 3.624s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1770966360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17165a91-d16d-47c4-beab-6b4a7dae2fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0300f0dba8374bdc86b84a1c031406bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:31:48Z,use_quota=True,user_id='f6fcc812d82746f39cd73476a50a9010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ced35728-73f1-4843-af94-c1e702335bfe),volume_type_id=ced35728-73f1-4843-af94-c1e702335bfe)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Creating volume 17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:32:03 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4f4ad7e2-27dc-49df-a083-202cad23eebf" returned: 0 in 0.390s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:03 devstack quobyte-client[84221]: System call of process 91552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:03 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=53, name=volume-17165a91-d16d-47c4-beab-6b4a7dae2fad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:32:03 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "cinder-quobyte-4f4ad7e2-27dc-49df-a083-202cad23eebf" released by "delete_volume" :: held 1.474s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:32:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad 1073741824" returned: 0 in 0.490s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad" returned: 0 in 0.216s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] <== create_volume: return (757ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:32:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:04 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Attempting download of 7f30ac35-80cf-463f-b1b9-95327f4c670a ((None, [{'url': 'file:///opt/stack/data/glance/images/7f30ac35-80cf-463f-b1b9-95327f4c670a', 'metadata': {}}])) to volume 17165a91-d16d-47c4-beab-6b4a7dae2fad. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 27 11:32:04 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Created reservations ['edc3be5d-105a-45a3-b323-2d48b3ecc069', 'ffd590be-1b4c-4112-bedb-7011dc174027', 'e4cdd9d4-b612-4149-840e-14d791521df6', 'a5e6b0fb-2aa8-4db1-9dde-29800645c0bb'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:32:04 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a44dbd-98e1-4aa5-ae12-f420f9a0c190]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:32:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f30ac35-80cf-463f-b1b9-95327f4c670a_px64d4l0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.171s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:32:05 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Deleted volume successfully.
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-228b13aa-60d4-4473-866d-01100e69e2dd tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "cinder-4f4ad7e2-27dc-49df-a083-202cad23eebf-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f30ac35-80cf-463f-b1b9-95327f4c670a_px64d4l0" returned: 0 in 0.720s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f30ac35-80cf-463f-b1b9-95327f4c670a_px64d4l0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f30ac35-80cf-463f-b1b9-95327f4c670a_px64d4l0" returned: 1 in 0.465s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f30ac35-80cf-463f-b1b9-95327f4c670a_px64d4l0' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:32:06 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a40912-f694-4b09-8ecb-9ea028cdb1ea]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:32:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:06 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] 7f30ac35-80cf-463f-b1b9-95327f4c670a was qcow2, converting to raw {{(pid=84197) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 27 11:32:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:07 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:07 devstack quobyte-client[84221]: System call of process 91572 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:07 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=53, name=volume-17165a91-d16d-47c4-beab-6b4a7dae2fad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Flow 'volume_create_manager' (bf21eb8e-6985-48e9-b3e4-a8b1f70f3012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac052a2-8697-4150-8c84-8aa8813fdfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac052a2-8697-4150-8c84-8aa8813fdfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1166374269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c00f498-8f63-4eba-b62c-fbd69c8b8c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fced0d7fc5842fc808d46f5540cbce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:06Z,use_quota=True,user_id='b8a8454605f24211abddd69bb02898a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1acf0f1-6b2e-4337-8979-2047ee291b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1acf0f1-6b2e-4337-8979-2047ee291b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d6aa9d-4140-4114-b450-12091d76f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d6aa9d-4140-4114-b450-12091d76f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c00f498-8f63-4eba-b62c-fbd69c8b8c5c', 'volume_name': 'volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73958fea-d8a6-41ed-ae1c-3830577a1278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73958fea-d8a6-41ed-ae1c-3830577a1278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b24d74-1c3b-497e-b2a5-ea276822c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:07 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Volume 4c00f498-8f63-4eba-b62c-fbd69c8b8c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c', 'volume_size': 1}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1166374269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c00f498-8f63-4eba-b62c-fbd69c8b8c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fced0d7fc5842fc808d46f5540cbce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:06Z,use_quota=True,user_id='b8a8454605f24211abddd69bb02898a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Creating volume 4c00f498-8f63-4eba-b62c-fbd69c8b8c5c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:32:07 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:32:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:07 devstack quobyte-client[84221]: System call of process 91583 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:07 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=54, name=volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c 1073741824" returned: 0 in 0.579s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad" returned: 0 in 1.579s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f30ac35-80cf-463f-b1b9-95327f4c670a_0gl53vvodevstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:32:08 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Converted 112.00 MB image at 68.33 MB/s
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c" returned: 0 in 0.247s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] <== create_volume: return (952ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:08 devstack quobyte-client[84221]: System call of process 91594 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:DELETE=6,cinder:SELECT=41,cinder:INSERT=13,cinder:UPDATE=51 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b24d74-1c3b-497e-b2a5-ea276822c6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aad6e05-a18c-4632-adf3-22ef09e22bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=34,cinder:INSERT=12,cinder:UPDATE=48,cinder:DELETE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:32:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad 1G" returned: 0 in 0.394s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:08 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Volume volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c (4c00f498-8f63-4eba-b62c-fbd69c8b8c5c): created successfully
Sep 27 11:32:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aad6e05-a18c-4632-adf3-22ef09e22bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Flow 'volume_create_manager' (bf21eb8e-6985-48e9-b3e4-a8b1f70f3012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:09 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73000ae-999b-41cb-a401-7e651cb0e9f3]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:32:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:09 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-908135d8-7e70-4c05-87db-7de93601ecf4 tempest-VolumeQuotasAdminTestJSON-77781748 None] Created volume successfully.
Sep 27 11:32:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad" returned: 0 in 0.550s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:10 devstack quobyte-client[84221]: System call of process 91627 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad" returned: 1 in 0.523s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Downloaded image 7f30ac35-80cf-463f-b1b9-95327f4c670a ((None, [{'url': 'file:///opt/stack/data/glance/images/7f30ac35-80cf-463f-b1b9-95327f4c670a', 'metadata': {}}])) to volume 17165a91-d16d-47c4-beab-6b4a7dae2fad successfully. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Temporary image 7f30ac35-80cf-463f-b1b9-95327f4c670a for user f6fcc812d82746f39cd73476a50a9010 is deleted. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Marking volume 17165a91-d16d-47c4-beab-6b4a7dae2fad as bootable. {{(pid=84197) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Copying metadata from image 7f30ac35-80cf-463f-b1b9-95327f4c670a to 17165a91-d16d-47c4-beab-6b4a7dae2fad. {{(pid=84197) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Creating volume glance metadata for volume 17165a91-d16d-47c4-beab-6b4a7dae2fad backed by image 7f30ac35-80cf-463f-b1b9-95327f4c670a with: {'image_id': '7f30ac35-80cf-463f-b1b9-95327f4c670a', 'image_name': 'tempest-scenario-img--1456870866', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84197) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdb042f-83d2-40fb-904e-1fd3626d7432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17165a91-d16d-47c4-beab-6b4a7dae2fad', 'volume_size': 1, 'image_id': '7f30ac35-80cf-463f-b1b9-95327f4c670a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f30ac35-80cf-463f-b1b9-95327f4c670a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1456870866', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0300f0dba8374bdc86b84a1c031406bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f30ac35-80cf-463f-b1b9-95327f4c670a', 'created_at': datetime.datetime(2025, 9, 27, 9, 31, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 31, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f30ac35-80cf-463f-b1b9-95327f4c670a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d0a5ab0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e7e592-cdad-4d06-84e9-9958170f2749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-da904d55-5ac3-4ed4-8d5d-72426ecb0d13 tempest-VolumeQuotasAdminTestJSON-639876753 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:10 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume volume-17165a91-d16d-47c4-beab-6b4a7dae2fad (17165a91-d16d-47c4-beab-6b4a7dae2fad): created successfully
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e7e592-cdad-4d06-84e9-9958170f2749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Flow 'volume_create_manager' (e3dc83aa-b300-437e-8785-78cfbdd30f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-da904d55-5ac3-4ed4-8d5d-72426ecb0d13 tempest-VolumeQuotasAdminTestJSON-639876753 None] Transfer volume completed successfully.
Sep 27 11:32:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f749bc9b-f0eb-4b82-a4a7-bff76d2cb991 tempest-TestInstancesWithCinderVolumes-471447094 None] Created volume successfully.
Sep 27 11:32:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Acquiring lock "cinder-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:32:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Lock "cinder-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:32:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Acquiring lock "cinder-quobyte-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:32:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Lock "cinder-quobyte-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c" acquired by "delete_volume" :: waited 0.021s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:32:12 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ed4362-4a33-4e1d-8e8c-5bff5f38397e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:32:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:12 devstack quobyte-client[84221]: System call of process 91630 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c" returned: 0 in 0.633s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c" returned: 0 in 0.175s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Lock "cinder-quobyte-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c" released by "delete_volume" :: held 1.074s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:32:13 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Created reservations ['867f75ac-0ce6-4715-8894-aedc988fba0c', '509825d6-c962-4d79-a587-32bea2e7a109', 'a363a9cf-997a-49f6-8dac-2476d29bcfa5', 'dad7557f-ab3a-46b2-9d20-ee58a2edd497'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:32:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.139s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:14 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:32:14 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Deleted volume successfully.
Sep 27 11:32:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-de4c6128-b75a-4190-b8da-714c61c62109 tempest-VolumeQuotasAdminTestJSON-554191628 None] Lock "cinder-4c00f498-8f63-4eba-b62c-fbd69c8b8c5c-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:32:23 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=13,cinder:DELETE=2,cinder:SELECT=6,cinder:INSERT=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:32:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:24 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8e2b0e-6dba-46ab-a92c-4d59bea5a83a]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:32:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:25 devstack quobyte-client[84221]: System call of process 91647 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:25 devstack quobyte-client[84221]: System call of process 91647 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad" returned: 0 in 0.588s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad" returned: 1 in 0.907s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:32:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.773s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-17165a91-d16d-47c4-beab-6b4a7dae2fad', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b45fe851-32db-4566-a22c-293c942f751e', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:32:26 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:26 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:26 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:32:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Flow 'volume_create_manager' (68f6e988-129b-4fad-9f64-c1e1cdb6bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3f9a1f-fa4e-45dc-a6b8-db4394885fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3f9a1f-fa4e-45dc-a6b8-db4394885fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-255982245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44e6241-8fbc-4931-bf68-35afc923811f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3725a0bdf0fe46c1b25f7fc851d1dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:27Z,use_quota=True,user_id='cd759503b30c4d2d8ce4e7c4103758ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4cfaf2-ef5c-47d1-823c-7caf277c10b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4cfaf2-ef5c-47d1-823c-7caf277c10b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0ab876-ae2e-4a6d-a952-733d72799f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0ab876-ae2e-4a6d-a952-733d72799f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f44e6241-8fbc-4931-bf68-35afc923811f', 'volume_name': 'volume-f44e6241-8fbc-4931-bf68-35afc923811f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ed9ca2-578f-477c-9b7b-d2454a1c1000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ed9ca2-578f-477c-9b7b-d2454a1c1000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e88d85-fd95-46af-81b8-c249ab9bc245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:27 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Volume f44e6241-8fbc-4931-bf68-35afc923811f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f44e6241-8fbc-4931-bf68-35afc923811f', 'volume_size': 1}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-255982245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44e6241-8fbc-4931-bf68-35afc923811f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3725a0bdf0fe46c1b25f7fc851d1dcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:27Z,use_quota=True,user_id='cd759503b30c4d2d8ce4e7c4103758ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Creating volume f44e6241-8fbc-4931-bf68-35afc923811f {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:32:27 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f44e6241-8fbc-4931-bf68-35afc923811f 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:27 devstack quobyte-client[84221]: System call of process 91652 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:27 devstack quobyte-client[84221]: System call of process 91652 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:27 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=55, name=volume-f44e6241-8fbc-4931-bf68-35afc923811f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f44e6241-8fbc-4931-bf68-35afc923811f 1073741824" returned: 0 in 0.734s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f44e6241-8fbc-4931-bf68-35afc923811f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:28 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-6308b2f1-da4a-4e8d-ba0a-88c0c7fd6ae2 req-febec73e-77f8-4b41-9d6b-13361bb8d2f7 tempest-TestInstancesWithCinderVolumes-471447094 None] attachment_update completed successfully.
Sep 27 11:32:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f44e6241-8fbc-4931-bf68-35afc923811f" returned: 0 in 0.401s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] <== create_volume: return (1183ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:32:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e88d85-fd95-46af-81b8-c249ab9bc245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f44e6241-8fbc-4931-bf68-35afc923811f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c692c42-0a9a-48be-a6fd-2460bfb74ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:28 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Volume volume-f44e6241-8fbc-4931-bf68-35afc923811f (f44e6241-8fbc-4931-bf68-35afc923811f): created successfully
Sep 27 11:32:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c692c42-0a9a-48be-a6fd-2460bfb74ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Flow 'volume_create_manager' (68f6e988-129b-4fad-9f64-c1e1cdb6bba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:28 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-eb10b0b5-60c7-45b4-ab20-9b2479ac9dfb tempest-VolumeQuotasNegativeTestJSON-852404836 None] Created volume successfully.
Sep 27 11:32:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Acquiring lock "cinder-f44e6241-8fbc-4931-bf68-35afc923811f-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:32:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "cinder-f44e6241-8fbc-4931-bf68-35afc923811f-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:32:31 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Acquiring lock "cinder-quobyte-f44e6241-8fbc-4931-bf68-35afc923811f" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:32:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "cinder-quobyte-f44e6241-8fbc-4931-bf68-35afc923811f" acquired by "delete_volume" :: waited 0.027s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:32:31 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cc3d53-feba-4eb5-9b97-0cc0ef2987b4]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:32:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f44e6241-8fbc-4931-bf68-35afc923811f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:31 devstack quobyte-client[84221]: System call of process 91665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f44e6241-8fbc-4931-bf68-35afc923811f" returned: 0 in 0.741s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f44e6241-8fbc-4931-bf68-35afc923811f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f44e6241-8fbc-4931-bf68-35afc923811f" returned: 0 in 0.123s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "cinder-quobyte-f44e6241-8fbc-4931-bf68-35afc923811f" released by "delete_volume" :: held 1.061s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Created reservations ['49ace06b-1d66-4dfb-849d-689e60e740f6', '0328ef41-12a9-40a3-bb87-b8f0e830ecae', '4fb229eb-7690-44aa-af50-395b8b151f28', 'da681310-6923-470e-b6f4-51d84be362d9'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.102s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:32 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:32:32 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Deleted volume successfully.
Sep 27 11:32:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-39be4132-7d8a-49c9-a329-24ddfeb7de15 tempest-VolumeQuotasNegativeTestJSON-852404836 None] Lock "cinder-f44e6241-8fbc-4931-bf68-35afc923811f-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:32:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:32:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 1.552s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:40 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:32:42 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=25,cinder:SELECT=31,cinder:INSERT=10,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:32:43 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:32:49 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Flow 'volume_create_manager' (414aaa3c-98ec-4e4c-a5dd-91fc03d5c3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abae6256-c262-4101-95d6-7a76a508dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abae6256-c262-4101-95d6-7a76a508dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1692665301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c87236e-055b-4229-946d-bfacca5e38ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999c243abb134927b48ff8b0388e856a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:48Z,use_quota=True,user_id='8df96c958e4445f3bf35c84cbc982199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec5d9fc-7cd8-442b-93d0-04b3e19b320a),volume_type_id=2ec5d9fc-7cd8-442b-93d0-04b3e19b320a)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4cebfa-3833-42f7-9fe4-da8ec98d740b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4cebfa-3833-42f7-9fe4-da8ec98d740b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65063f99-1ab1-493d-af5d-d8d8f19edd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65063f99-1ab1-493d-af5d-d8d8f19edd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c87236e-055b-4229-946d-bfacca5e38ec', 'volume_name': 'volume-9c87236e-055b-4229-946d-bfacca5e38ec', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb48307-9e97-4eb8-a783-086d3a92bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb48307-9e97-4eb8-a783-086d3a92bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273cb290-ba6c-4389-972f-8e5d661bcc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:49 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Volume 9c87236e-055b-4229-946d-bfacca5e38ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c87236e-055b-4229-946d-bfacca5e38ec', 'volume_size': 1}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1692665301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c87236e-055b-4229-946d-bfacca5e38ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999c243abb134927b48ff8b0388e856a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:48Z,use_quota=True,user_id='8df96c958e4445f3bf35c84cbc982199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec5d9fc-7cd8-442b-93d0-04b3e19b320a),volume_type_id=2ec5d9fc-7cd8-442b-93d0-04b3e19b320a)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Creating volume 9c87236e-055b-4229-946d-bfacca5e38ec {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:32:49 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:32:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9c87236e-055b-4229-946d-bfacca5e38ec 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:50 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=56, name=volume-9c87236e-055b-4229-946d-bfacca5e38ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:32:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9c87236e-055b-4229-946d-bfacca5e38ec 1073741824" returned: 0 in 1.524s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9c87236e-055b-4229-946d-bfacca5e38ec {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:51 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:51 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Flow 'volume_create_manager' (4f76eb71-5b95-4b39-8b87-740401e34ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d63ff74-d3f0-43d6-b69a-06d331619700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d63ff74-d3f0-43d6-b69a-06d331619700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-501685403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7308368-5b7f-45e4-aa69-87176d1209ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3659cf69a04f4b97988ee510bf3cc8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:49Z,use_quota=True,user_id='5132d04e1ff54907b8aa4ace806c4a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe90504-6616-46dd-a0bd-0da9d8487429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe90504-6616-46dd-a0bd-0da9d8487429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce584d28-aebc-481b-9cc7-1e0d4e2e01c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce584d28-aebc-481b-9cc7-1e0d4e2e01c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7308368-5b7f-45e4-aa69-87176d1209ef', 'volume_name': 'volume-a7308368-5b7f-45e4-aa69-87176d1209ef', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a71a0c-e09f-4990-b9b4-b5a03ae610b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a71a0c-e09f-4990-b9b4-b5a03ae610b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ac8020-f8d5-4e41-9034-7126a427e06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:52 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume a7308368-5b7f-45e4-aa69-87176d1209ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7308368-5b7f-45e4-aa69-87176d1209ef', 'volume_size': 1}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9c87236e-055b-4229-946d-bfacca5e38ec" returned: 0 in 1.485s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] <== create_volume: return (3094ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.123s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.162s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-501685403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7308368-5b7f-45e4-aa69-87176d1209ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3659cf69a04f4b97988ee510bf3cc8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:32:49Z,use_quota=True,user_id='5132d04e1ff54907b8aa4ace806c4a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Creating volume a7308368-5b7f-45e4-aa69-87176d1209ef {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:32:52 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:32:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a7308368-5b7f-45e4-aa69-87176d1209ef 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:53 devstack quobyte-client[84221]: System call of process 92209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:32:53 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=57, name=volume-a7308368-5b7f-45e4-aa69-87176d1209ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:32:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273cb290-ba6c-4389-972f-8e5d661bcc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c87236e-055b-4229-946d-bfacca5e38ec', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaebf74-a116-426d-b9f8-ee7fb3746cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a7308368-5b7f-45e4-aa69-87176d1209ef 1073741824" returned: 0 in 1.250s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a7308368-5b7f-45e4-aa69-87176d1209ef {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:54 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Volume volume-9c87236e-055b-4229-946d-bfacca5e38ec (9c87236e-055b-4229-946d-bfacca5e38ec): created successfully
Sep 27 11:32:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaebf74-a116-426d-b9f8-ee7fb3746cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Flow 'volume_create_manager' (414aaa3c-98ec-4e4c-a5dd-91fc03d5c3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b298154c-f140-4e4c-94d4-eee350dda58f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Created volume successfully.
Sep 27 11:32:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a7308368-5b7f-45e4-aa69-87176d1209ef" returned: 0 in 1.155s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:55 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] <== create_volume: return (2486ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:32:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.523s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:55 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ac8020-f8d5-4e41-9034-7126a427e06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7308368-5b7f-45e4-aa69-87176d1209ef', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a82b13-8e2c-49a2-b188-f77d0e5026d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:32:55 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume volume-a7308368-5b7f-45e4-aa69-87176d1209ef (a7308368-5b7f-45e4-aa69-87176d1209ef): created successfully
Sep 27 11:32:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a82b13-8e2c-49a2-b188-f77d0e5026d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:32:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Flow 'volume_create_manager' (4f76eb71-5b95-4b39-8b87-740401e34ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:32:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-47d22c49-9c8d-4c75-868f-d5f4c140ab35 tempest-AttachVolumeShelveTestJSON-952316277 None] Created volume successfully.
Sep 27 11:32:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:32:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:32:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:32:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:32:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:32:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:32:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.171s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:32:56 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:32:57 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1324f762-fb07-4d46-ba65-0bbba3b8db9f tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Retype volume completed successfully.
Sep 27 11:32:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Acquiring lock "cinder-9c87236e-055b-4229-946d-bfacca5e38ec-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:32:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "cinder-9c87236e-055b-4229-946d-bfacca5e38ec-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:32:58 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:32:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Acquiring lock "cinder-quobyte-9c87236e-055b-4229-946d-bfacca5e38ec" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:32:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "cinder-quobyte-9c87236e-055b-4229-946d-bfacca5e38ec" acquired by "delete_volume" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:32:58 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b4d8ea-44ab-4af9-b935-51af921544b7]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:32:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9c87236e-055b-4229-946d-bfacca5e38ec {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9c87236e-055b-4229-946d-bfacca5e38ec" returned: 0 in 1.286s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:33:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9c87236e-055b-4229-946d-bfacca5e38ec {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9c87236e-055b-4229-946d-bfacca5e38ec" returned: 0 in 0.323s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:33:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "cinder-quobyte-9c87236e-055b-4229-946d-bfacca5e38ec" released by "delete_volume" :: held 2.087s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:33:01 devstack cinder-volume[84197]: WARNING cinder.quota [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:33:01 devstack cinder-volume[84197]: WARNING cinder.quota [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:33:01 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Created reservations ['5e7fde41-05b0-4f85-95d7-13d37b47aeae', '49c92d39-d8ef-4cf4-9e63-acc597fbf78d', '3af243d8-e838-42c4-aff2-743c34f2c79f', '87254f8b-2a0e-4fa8-9c99-66e2021489d1'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:33:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:33:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:33:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:33:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:33:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:33:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.973s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:33:03 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:33:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Deleted volume successfully.
Sep 27 11:33:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0c71942a-b32a-49f0-ab99-60b5214c3bf3 tempest-VolumeRetypeWithoutMigrationTest-1532160798 None] Lock "cinder-9c87236e-055b-4229-946d-bfacca5e38ec-delete_volume" released by "delete_volume" :: held 6.638s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:33:11 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=17,cinder:SELECT=13,cinder:INSERT=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:33:14 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=15,cinder:DELETE=3,cinder:UPDATE=16,cinder:INSERT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:33:19 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:33:19 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Flow 'volume_create_manager' (1c9c74fb-bac7-4da2-967d-16bce1bb7911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873db749-be00-48d1-9e77-bcfb4b3c0418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873db749-be00-48d1-9e77-bcfb4b3c0418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2044866432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7406f4-4481-4bed-ac3d-04fbbaee9f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903955bb769244c195531f32fb5379f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:33:19Z,use_quota=True,user_id='c117fa8a74d149f194227760cfb5eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65df2a34-9f76-4a47-9114-f6d331daf3ed),volume_type_id=65df2a34-9f76-4a47-9114-f6d331daf3ed)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cf625c-20e5-422c-8a3c-3b38b87707aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cf625c-20e5-422c-8a3c-3b38b87707aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208ad7b9-5ea9-49aa-af7d-1e6a406cb564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208ad7b9-5ea9-49aa-af7d-1e6a406cb564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f7406f4-4481-4bed-ac3d-04fbbaee9f2c', 'volume_name': 'volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806ffe11-4544-4077-a269-c1e22cbaaf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806ffe11-4544-4077-a269-c1e22cbaaf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24c4c67-8f93-4af2-8ead-fa38059b7efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:33:20 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Volume 6f7406f4-4481-4bed-ac3d-04fbbaee9f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c', 'volume_size': 1}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2044866432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7406f4-4481-4bed-ac3d-04fbbaee9f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903955bb769244c195531f32fb5379f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:33:19Z,use_quota=True,user_id='c117fa8a74d149f194227760cfb5eb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65df2a34-9f76-4a47-9114-f6d331daf3ed),volume_type_id=65df2a34-9f76-4a47-9114-f6d331daf3ed)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Creating volume 6f7406f4-4481-4bed-ac3d-04fbbaee9f2c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:33:20 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:33:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:20 devstack quobyte-client[84221]: System call of process 92298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:33:20 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=58, name=volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:33:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c 1073741824" returned: 0 in 0.628s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:33:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c" returned: 0 in 0.263s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:33:21 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] <== create_volume: return (1039ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:33:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:33:21 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24c4c67-8f93-4af2-8ead-fa38059b7efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:33:21 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60d63c7-17c2-4a5e-96a0-77ab485b7049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:33:21 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Volume volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c (6f7406f4-4481-4bed-ac3d-04fbbaee9f2c): created successfully
Sep 27 11:33:21 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60d63c7-17c2-4a5e-96a0-77ab485b7049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:33:21 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Flow 'volume_create_manager' (1c9c74fb-bac7-4da2-967d-16bce1bb7911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:33:21 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-3f0bcaf3-21b3-48b6-9e60-dbf3021d4e1f tempest-VolumeTypesAccessTest-1863033647 None] Created volume successfully.
Sep 27 11:33:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Acquiring lock "cinder-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:33:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Lock "cinder-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:33:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:33:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Acquiring lock "cinder-quobyte-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:33:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Lock "cinder-quobyte-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c" acquired by "delete_volume" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:33:23 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a30724a-6635-4cef-8b7e-71e0e045d602]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:33:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:23 devstack quobyte-client[84221]: System call of process 92308 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:33:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c" returned: 0 in 0.558s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:33:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c" returned: 0 in 0.169s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Lock "cinder-quobyte-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c" released by "delete_volume" :: held 1.058s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:33:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-db1b20b4-fac5-4341-b5e2-66ec3a78219f req-02b38891-75cf-4158-bcd4-52f6443a0594 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:33:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-db1b20b4-fac5-4341-b5e2-66ec3a78219f req-02b38891-75cf-4158-bcd4-52f6443a0594 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-db1b20b4-fac5-4341-b5e2-66ec3a78219f req-02b38891-75cf-4158-bcd4-52f6443a0594 tempest-AttachVolumeShelveTestJSON-952316277 None] No connector for attachment a6909127-3512-4e7a-8e56-185365ac58c4; skipping storage backend terminate_connection call. {{(pid=84197) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-db1b20b4-fac5-4341-b5e2-66ec3a78219f req-02b38891-75cf-4158-bcd4-52f6443a0594 tempest-AttachVolumeShelveTestJSON-952316277 None] Deleting attachment a6909127-3512-4e7a-8e56-185365ac58c4. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:33:24 devstack cinder-volume[84197]: WARNING cinder.quota [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-300901475 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-300901475, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:33:24 devstack cinder-volume[84197]: WARNING cinder.quota [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-300901475 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-300901475, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Created reservations ['6db85348-aade-479d-8f18-f6eb1327b02e', 'b023bdad-63c2-4627-8328-dd61ad3964e9', '76716f77-78f4-4654-8916-8736f664843c', '85af1fb7-1d85-49b8-9b91-b0385e8d1d70'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.143s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:33:24 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:33:25 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Deleted volume successfully.
Sep 27 11:33:25 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d2c8d729-3e49-410b-988f-75f0d6d78aa3 tempest-VolumeTypesAccessTest-1863033647 None] Lock "cinder-6f7406f4-4481-4bed-ac3d-04fbbaee9f2c-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:33:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:33:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:33:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:33:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:33:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:33:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:33:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.317s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:33:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:33:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=10,cinder:SELECT=8,cinder:DELETE=2,cinder:INSERT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:33:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:33:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-1f80945b-2b3b-4567-8eeb-acebf5a7c295 req-b3df77e4-b01a-4038-94b5-384c681ab639 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:33:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-1f80945b-2b3b-4567-8eeb-acebf5a7c295 req-b3df77e4-b01a-4038-94b5-384c681ab639 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:33:58 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dd98cb-7a21-4701-9b28-f932a818acca]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:33:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1f80945b-2b3b-4567-8eeb-acebf5a7c295 req-b3df77e4-b01a-4038-94b5-384c681ab639 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:33:59 devstack quobyte-client[84221]: System call of process 92432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:33:59 devstack quobyte-client[84221]: System call of process 92432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:33:59 devstack quobyte-client[84221]: System call of process 92432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1f80945b-2b3b-4567-8eeb-acebf5a7c295 req-b3df77e4-b01a-4038-94b5-384c681ab639 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768" returned: 0 in 1.619s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-1f80945b-2b3b-4567-8eeb-acebf5a7c295 req-b3df77e4-b01a-4038-94b5-384c681ab639 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.731s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-1f80945b-2b3b-4567-8eeb-acebf5a7c295 req-b3df77e4-b01a-4038-94b5-384c681ab639 tempest-TestInstancesWithCinderVolumes-471447094 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-6928ac28-56f8-4fcf-8920-d615da97d768', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d0473db-ebdc-401a-af9c-530c719cdc83', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:34:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-1f80945b-2b3b-4567-8eeb-acebf5a7c295 req-b3df77e4-b01a-4038-94b5-384c681ab639 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:01 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-1f80945b-2b3b-4567-8eeb-acebf5a7c295 req-b3df77e4-b01a-4038-94b5-384c681ab639 tempest-TestInstancesWithCinderVolumes-471447094 None] attachment_update completed successfully.
Sep 27 11:34:07 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Flow 'volume_create_manager' (6ce1eca4-9c1d-4c1a-8411-90aad7df563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be451c6-122b-4d3d-8f1d-edaf951b136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be451c6-122b-4d3d-8f1d-edaf951b136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-363600252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f872c6-7fb6-44c2-8c86-138dfa4dd7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faef315829b46e3be777fb7bb08958a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:34:07Z,use_quota=True,user_id='9a6f117ce80f486dbfad81011774bcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba70ee0-639a-49b3-afb4-01e1d7746ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba70ee0-639a-49b3-afb4-01e1d7746ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a6dd84-453b-47a6-8fc2-38eb4f1c15c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a6dd84-453b-47a6-8fc2-38eb4f1c15c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f872c6-7fb6-44c2-8c86-138dfa4dd7c7', 'volume_name': 'volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6962f5e-dff0-4c33-bc05-84ccf4ca57b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6962f5e-dff0-4c33-bc05-84ccf4ca57b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48888bd-0fcc-4f30-8de7-8ba02fe57236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:07 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Volume 61f872c6-7fb6-44c2-8c86-138dfa4dd7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7', 'volume_size': 1}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-363600252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f872c6-7fb6-44c2-8c86-138dfa4dd7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faef315829b46e3be777fb7bb08958a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:34:07Z,use_quota=True,user_id='9a6f117ce80f486dbfad81011774bcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Creating volume 61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:34:07 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:34:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:07 devstack quobyte-client[84221]: System call of process 92521 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:08 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=59, name=volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:34:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 1073741824" returned: 0 in 0.833s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" returned: 0 in 0.295s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] <== create_volume: return (1302ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:34:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48888bd-0fcc-4f30-8de7-8ba02fe57236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6535a708-a313-44ad-999e-c2bf46191384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:09 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Volume volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 (61f872c6-7fb6-44c2-8c86-138dfa4dd7c7): created successfully
Sep 27 11:34:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6535a708-a313-44ad-999e-c2bf46191384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Flow 'volume_create_manager' (6ce1eca4-9c1d-4c1a-8411-90aad7df563c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:34:09 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e464982c-0d56-4933-8d44-176c0624e821 tempest-VolumesDeleteCascade-1762127628 None] Created volume successfully.
Sep 27 11:34:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Creating offline snapshot d0d9feba-3c31-4d74-b1fd-c70f19c167b6 of volume 61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:34:10 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[056e5cc0-f8b1-448c-815e-e0561ef4b366]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:10 devstack quobyte-client[84221]: System call of process 92532 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" returned: 0 in 0.515s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:10 devstack quobyte-client[84221]: System call of process 92535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:10 devstack quobyte-client[84221]: System call of process 92535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:10 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=60, name=volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 1G" returned: 0 in 0.337s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img rebase -u -b volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img rebase -u -b volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6" returned: 0 in 0.199s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6" returned: 0 in 0.098s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6" returned: 0 in 0.092s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.info" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.info" returned: 0 in 0.099s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0a0bb5e9-5fc6-4fcd-aff7-65600eee5032 tempest-VolumesDeleteCascade-1762127628 None] Create snapshot completed successfully
Sep 27 11:34:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-256d20a3-3380-45a4-bfd7-a630292b2913 req-e46b67c0-6a0e-4200-95dd-d4c8ac2aa8d2 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-256d20a3-3380-45a4-bfd7-a630292b2913 req-e46b67c0-6a0e-4200-95dd-d4c8ac2aa8d2 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:13 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9421a3d-ac74-4fcb-b03a-39612e590157]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-256d20a3-3380-45a4-bfd7-a630292b2913 req-e46b67c0-6a0e-4200-95dd-d4c8ac2aa8d2 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:13 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-256d20a3-3380-45a4-bfd7-a630292b2913 req-e46b67c0-6a0e-4200-95dd-d4c8ac2aa8d2 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f" returned: 0 in 0.495s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-256d20a3-3380-45a4-bfd7-a630292b2913 req-e46b67c0-6a0e-4200-95dd-d4c8ac2aa8d2 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.536s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.464s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Creating offline snapshot 384d7d4a-4797-425b-8f6e-86df2dcceebd of volume 61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:34:14 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62054ab-b494-42f3-9820-92e6b3190d12]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-256d20a3-3380-45a4-bfd7-a630292b2913 req-e46b67c0-6a0e-4200-95dd-d4c8ac2aa8d2 tempest-TestInstancesWithCinderVolumes-471447094 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b51f7168-3782-481c-8164-fa713cf3fda0', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:34:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-256d20a3-3380-45a4-bfd7-a630292b2913 req-e46b67c0-6a0e-4200-95dd-d4c8ac2aa8d2 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:15 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-256d20a3-3380-45a4-bfd7-a630292b2913 req-e46b67c0-6a0e-4200-95dd-d4c8ac2aa8d2 tempest-TestInstancesWithCinderVolumes-471447094 None] attachment_update completed successfully.
Sep 27 11:34:15 devstack quobyte-client[84221]: System call of process 92558 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6" returned: 0 in 0.751s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:34:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:15 devstack quobyte-client[84221]: System call of process 92561 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:15 devstack quobyte-client[84221]: System call of process 92561 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:15 devstack quobyte-client[84221]: System call of process 92561 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:15 devstack quobyte-client[84221]: System call of process 92561 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:15 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=62, name=volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:34:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd 1G" returned: 0 in 0.358s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img rebase -u -b volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:15 devstack quobyte-client[84221]: System call of process 92564 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img rebase -u -b volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd" returned: 0 in 0.279s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:34:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd" returned: 0 in 0.166s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:34:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd" returned: 0 in 0.195s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:16 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-65e1753d-ee06-4fb7-9e1d-47f4a7d85a62 tempest-VolumesDeleteCascade-1762127628 None] Create snapshot completed successfully
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Performing cascade delete. {{(pid=84197) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-384d7d4a-4797-425b-8f6e-86df2dcceebd-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-384d7d4a-4797-425b-8f6e-86df2dcceebd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-384d7d4a-4797-425b-8f6e-86df2dcceebd" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-384d7d4a-4797-425b-8f6e-86df2dcceebd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Deleting offline snapshot 384d7d4a-4797-425b-8f6e-86df2dcceebd of volume 61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] snapshot_file for this snap is: volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d5644b-1fe2-4ddd-8163-074a678b1f08]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:18 devstack quobyte-client[84221]: System call of process 92575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:18 devstack quobyte-client[84221]: System call of process 92575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:18 devstack quobyte-client[84221]: System call of process 92575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd" returned: 0 in 0.518s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:34:18 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a02e2-1db2-4123-b5b6-4c47a2e66662]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:18 devstack quobyte-client[84221]: System call of process 92578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6" returned: 0 in 0.519s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:34:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:19 devstack quobyte-client[84221]: System call of process 92581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd" returned: 0 in 0.393s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.384d7d4a-4797-425b-8f6e-86df2dcceebd" returned: 0 in 0.148s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:19 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-384d7d4a-4797-425b-8f6e-86df2dcceebd" released by "_delete_snapshot" :: held 1.922s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:19 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" released by "delete_snapshot" :: held 1.946s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Created reservations ['05b25ff1-f0cc-4fa8-a94f-b1b95b0808a2', '921f0b77-5682-40b3-969a-198b78c838da', 'e97b79e3-a4d2-4a6c-a298-1e9db6f10bb9', '6c0f0342-44a6-4179-8c2b-1777951df0b0'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:34:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Delete snapshot completed successfully.
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-384d7d4a-4797-425b-8f6e-86df2dcceebd-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-d0d9feba-3c31-4d74-b1fd-c70f19c167b6-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-d0d9feba-3c31-4d74-b1fd-c70f19c167b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:20 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-d0d9feba-3c31-4d74-b1fd-c70f19c167b6" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-d0d9feba-3c31-4d74-b1fd-c70f19c167b6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Deleting offline snapshot d0d9feba-3c31-4d74-b1fd-c70f19c167b6 of volume 61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] snapshot_file for this snap is: volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[462c9ccd-ca11-4ddb-b80d-84ab04ddbae9]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:21 devstack quobyte-client[84221]: System call of process 92587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6" returned: 0 in 0.816s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:21 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:34:21 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afd39a8-5fca-42bc-892f-48949e6cefee]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:22 devstack quobyte-client[84221]: System call of process 92596 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" returned: 0 in 0.681s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:22 devstack quobyte-client[84221]: System call of process 92599 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6" returned: 0 in 0.324s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7.d0d9feba-3c31-4d74-b1fd-c70f19c167b6" returned: 0 in 0.123s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-d0d9feba-3c31-4d74-b1fd-c70f19c167b6" released by "_delete_snapshot" :: held 2.365s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" released by "delete_snapshot" :: held 2.402s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:23 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Created reservations ['9f664584-13a7-4310-b3b3-83b7d0c87d31', 'e96c838e-9e19-447c-8e57-a36f6fa7b9d1', '3b116b30-3be9-4e3c-86d7-427a60c25de3', '9ec7b518-5030-42a3-b5e8-49f634196d2b'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:34:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Delete snapshot completed successfully.
Sep 27 11:34:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-d0d9feba-3c31-4d74-b1fd-c70f19c167b6-delete_snapshot" released by "delete_snapshot" :: held 3.005s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Snapshots deleted, issuing volume delete {{(pid=84197) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 27 11:34:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" acquired by "delete_volume" :: waited 0.018s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:23 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a5ea2a-0b17-4176-ad6e-e67f7acc81f5]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" returned: 0 in 0.511s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" returned: 0 in 0.219s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7" released by "delete_volume" :: held 1.005s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:24 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Created reservations ['07af9c4f-8a74-4993-921d-f80322b90248', 'f1d1c7ca-88f2-432d-b3d5-a3f480e9eb20', 'a43e3b86-8b85-4361-88f9-9dbbcc356326', 'd2809e3e-47b2-4be0-aa14-c7b20d67c9e1'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:34:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:34:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:34:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.188s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:25 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:34:25 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Deleted volume successfully.
Sep 27 11:34:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7b952923-88e5-4204-b7c8-711bb1fe8612 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-61f872c6-7fb6-44c2-8c86-138dfa4dd7c7-delete_volume" released by "delete_volume" :: held 8.479s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Flow 'volume_create_manager' (fb89cdf2-25b8-4d96-8e3d-6067a344322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6a43a-5aaa-410f-a026-3bb4d87690d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6a43a-5aaa-410f-a026-3bb4d87690d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1376858055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5ad65c-f98f-4036-aeec-9615431152a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faef315829b46e3be777fb7bb08958a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:34:27Z,use_quota=True,user_id='9a6f117ce80f486dbfad81011774bcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b6e8d9-a5a4-421d-b10b-700daa5e2fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b6e8d9-a5a4-421d-b10b-700daa5e2fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda288e5-bbe9-4995-b956-a876f283ccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda288e5-bbe9-4995-b956-a876f283ccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca5ad65c-f98f-4036-aeec-9615431152a5', 'volume_name': 'volume-ca5ad65c-f98f-4036-aeec-9615431152a5', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd94b49a-609d-415d-b18c-3b80a5d58980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd94b49a-609d-415d-b18c-3b80a5d58980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0355990e-4b2c-40b1-9ef1-97ce0a11cdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:27 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Volume ca5ad65c-f98f-4036-aeec-9615431152a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca5ad65c-f98f-4036-aeec-9615431152a5', 'volume_size': 1}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1376858055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5ad65c-f98f-4036-aeec-9615431152a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faef315829b46e3be777fb7bb08958a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:34:27Z,use_quota=True,user_id='9a6f117ce80f486dbfad81011774bcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Creating volume ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:34:27 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:34:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:27 devstack quobyte-client[84221]: System call of process 92651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:27 devstack quobyte-client[84221]: System call of process 92651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:27 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=63, name=volume-ca5ad65c-f98f-4036-aeec-9615431152a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:34:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 1073741824" returned: 0 in 0.755s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5" returned: 0 in 0.193s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] <== create_volume: return (1078ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:34:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0355990e-4b2c-40b1-9ef1-97ce0a11cdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca5ad65c-f98f-4036-aeec-9615431152a5', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3ccebf-feb5-4b30-b8da-6205fb720656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:29 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Volume volume-ca5ad65c-f98f-4036-aeec-9615431152a5 (ca5ad65c-f98f-4036-aeec-9615431152a5): created successfully
Sep 27 11:34:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3ccebf-feb5-4b30-b8da-6205fb720656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Flow 'volume_create_manager' (fb89cdf2-25b8-4d96-8e3d-6067a344322c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:34:29 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-37b2ccbe-3bec-4f04-b3c4-7e03a49cd779 tempest-VolumesDeleteCascade-1762127628 None] Created volume successfully.
Sep 27 11:34:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Creating offline snapshot c3708c0e-a07a-4e8a-9376-49321b17be8d of volume ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:34:30 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[62028d3c-7752-4435-bc67-bd72619765db]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:30 devstack quobyte-client[84221]: System call of process 92664 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5" returned: 0 in 0.588s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:31 devstack quobyte-client[84221]: System call of process 92667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:31 devstack quobyte-client[84221]: System call of process 92667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:31 devstack quobyte-client[84221]: System call of process 92667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:31 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=64, name=volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d 1G" returned: 0 in 0.454s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ca5ad65c-f98f-4036-aeec-9615431152a5 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img rebase -u -b volume-ca5ad65c-f98f-4036-aeec-9615431152a5 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d" returned: 0 in 0.202s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d" returned: 0 in 0.141s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d" returned: 0 in 0.127s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.info" returned: 0 in 0.147s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:34:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.info" returned: 0 in 0.153s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:32 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f62ab9b7-8478-4645-b686-ce4a2673baf7 tempest-VolumesDeleteCascade-1762127628 None] Create snapshot completed successfully
Sep 27 11:34:33 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:33 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Flow 'volume_create_manager' (9b344543-11db-4381-bba4-8f9c0331c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa613ef-967c-4463-acb4-863e08c91161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa613ef-967c-4463-acb4-863e08c91161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1549402757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7faef315829b46e3be777fb7bb08958a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3708c0e-a07a-4e8a-9376-49321b17be8d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:34:34Z,use_quota=True,user_id='9a6f117ce80f486dbfad81011774bcf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bce70ef-133b-4a07-9304-ed4392be0504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bce70ef-133b-4a07-9304-ed4392be0504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4f7565-338b-4578-9106-dcc70974df5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4f7565-338b-4578-9106-dcc70974df5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5', 'volume_name': 'volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5', 'volume_size': 1, 'snapshot_id': 'c3708c0e-a07a-4e8a-9376-49321b17be8d'}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f1efa5-7b36-4633-9e0d-8720c0bacc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f1efa5-7b36-4633-9e0d-8720c0bacc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0044d00d-1c88-4783-8fc4-b94f826791ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:34 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Volume 6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5', 'volume_size': 1, 'snapshot_id': 'c3708c0e-a07a-4e8a-9376-49321b17be8d'}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-c3708c0e-a07a-4e8a-9376-49321b17be8d-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" by "_create_volume_from_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-c3708c0e-a07a-4e8a-9376-49321b17be8d-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Creating volume 6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5 from snapshot c3708c0e-a07a-4e8a-9376-49321b17be8d {{(pid=84197) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" by "_copy_volume_from_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] snapshot: c3708c0e-a07a-4e8a-9376-49321b17be8d, volume: 6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5,  {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[581a9931-50c4-4032-8267-cfa5596150ce]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:34 devstack quobyte-client[84221]: System call of process 92682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:34 devstack quobyte-client[84221]: System call of process 92682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:34 devstack quobyte-client[84221]: System call of process 92682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d" returned: 0 in 0.495s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca5ad65c-f98f-4036-aeec-9615431152a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Creating direct copy from snapshot {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74ad2a0-86fb-443e-976f-0485e1a0e00f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5" returned: 0 in 0.480s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:35 devstack cinder-volume[84197]: DEBUG cinder.utils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5 not found in is_blk_device check {{(pid=84197) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 27 11:34:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:35 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=66, name=volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:34:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:34:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.038s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:34:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:34:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.088s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.699s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:40 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:34:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" returned: 0 in 8.037s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:43 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[55299988-2f65-45d7-ad3e-eedc97f8ece5]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=36,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:34:44 devstack quobyte-client[84221]: System call of process 92713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=34,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:34:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5" returned: 0 in 1.163s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:44 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5 {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:34:44 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Converted 1024.00 MB image at 127.12 MB/s
Sep 27 11:34:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:34:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" returned: 0 in 0.159s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" released by "_copy_volume_from_snapshot" :: held 10.736s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-c3708c0e-a07a-4e8a-9376-49321b17be8d-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" released by "_create_volume_from_snapshot" :: held 10.786s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.816s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0044d00d-1c88-4783-8fc4-b94f826791ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5', 'volume_size': 1, 'snapshot_id': 'c3708c0e-a07a-4e8a-9376-49321b17be8d'}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd3e913-1649-40a2-9c8c-2205af2d08cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:34:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Volume volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5 (6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5): created successfully
Sep 27 11:34:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd3e913-1649-40a2-9c8c-2205af2d08cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:34:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Flow 'volume_create_manager' (9b344543-11db-4381-bba4-8f9c0331c485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:34:45 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-92bde51a-72c0-473a-bac7-a3366a2516d2 tempest-VolumesDeleteCascade-1762127628 None] Created volume successfully.
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-ca5ad65c-f98f-4036-aeec-9615431152a5-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-ca5ad65c-f98f-4036-aeec-9615431152a5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:46 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Performing cascade delete. {{(pid=84197) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-c3708c0e-a07a-4e8a-9376-49321b17be8d-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-c3708c0e-a07a-4e8a-9376-49321b17be8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:46 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-ca5ad65c-f98f-4036-aeec-9615431152a5" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-ca5ad65c-f98f-4036-aeec-9615431152a5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-c3708c0e-a07a-4e8a-9376-49321b17be8d" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-c3708c0e-a07a-4e8a-9376-49321b17be8d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Deleting offline snapshot c3708c0e-a07a-4e8a-9376-49321b17be8d of volume ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] snapshot_file for this snap is: volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5979231-1ff4-44c8-b6f0-f8961098e23a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d" returned: 0 in 0.451s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca5ad65c-f98f-4036-aeec-9615431152a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:34:47 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[f265016c-aa3f-4364-8977-a2c1463a1418]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5" returned: 0 in 0.491s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:47 devstack quobyte-client[84221]: System call of process 92746 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d" returned: 0 in 0.251s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5.c3708c0e-a07a-4e8a-9376-49321b17be8d" returned: 0 in 0.098s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-c3708c0e-a07a-4e8a-9376-49321b17be8d" released by "_delete_snapshot" :: held 1.610s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-ca5ad65c-f98f-4036-aeec-9615431152a5" released by "delete_snapshot" :: held 1.644s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Created reservations ['e6fff762-f2fa-44e8-8e7e-994e52dec17a', 'dfd40e62-6698-4e41-88e9-32b6e39f8b24', 'd0a0e262-58c8-4184-be34-93f7ba7cdcb9', '61298b97-3478-4ea0-95b9-f0775479e9ba'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:34:48 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Delete snapshot completed successfully.
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-c3708c0e-a07a-4e8a-9376-49321b17be8d-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Snapshots deleted, issuing volume delete {{(pid=84197) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-ca5ad65c-f98f-4036-aeec-9615431152a5" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-ca5ad65c-f98f-4036-aeec-9615431152a5" acquired by "delete_volume" :: waited 0.022s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14a427-4cb7-4cef-abe6-02dd4c64d1be]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:49 devstack quobyte-client[84221]: System call of process 92751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:49 devstack quobyte-client[84221]: System call of process 92751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5" returned: 0 in 0.597s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ca5ad65c-f98f-4036-aeec-9615431152a5" returned: 0 in 0.093s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-ca5ad65c-f98f-4036-aeec-9615431152a5" released by "delete_volume" :: held 0.976s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:50 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Created reservations ['82443550-ac3f-49d5-b871-15900dc124e1', '7acddd00-e0d7-466b-97bb-e2054ba7ad91', '9ab6a036-49a8-4036-9625-b8ec5d759db2', '9cb14f2f-0107-4710-be3c-e924e5bfa04e'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:34:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:34:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:34:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.185s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:50 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:34:50 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Deleted volume successfully.
Sep 27 11:34:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cdccd3e3-b236-4389-85b1-7133b3e8ec36 tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-ca5ad65c-f98f-4036-aeec-9615431152a5-delete_volume" released by "delete_volume" :: held 4.825s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:51 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "cinder-quobyte-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" acquired by "delete_volume" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:51 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b5b8e9-2d09-4acf-bda4-db4aa0a83466]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:51 devstack quobyte-client[84221]: System call of process 92762 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:51 devstack quobyte-client[84221]: System call of process 92762 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:51 devstack quobyte-client[84221]: System call of process 92762 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" returned: 0 in 0.520s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" returned: 0 in 0.129s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-quobyte-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5" released by "delete_volume" :: held 0.939s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Created reservations ['5fabdc8e-0666-4c88-8f3b-ed2d8edf4ebc', 'ebec69cd-a9a9-4d3a-b432-4dde78fb8d3f', '4c0409b4-bfbc-495d-aa57-3395fd2e5510', 'a4bc7db4-c3d2-4fcb-965c-2f392b49c1b1'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.099s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:53 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:34:53 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Deleted volume successfully.
Sep 27 11:34:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-45428edc-3961-46d1-8962-70036418054b tempest-VolumesDeleteCascade-1762127628 None] Lock "cinder-6404e6d2-a2cc-4d40-b77b-3a3d659f0eb5-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:53 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-0ca716fb-894a-44ce-8085-70741df421f1 req-650001cc-75f0-475b-af92-6490427cff33 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:53 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-0ca716fb-894a-44ce-8085-70741df421f1 req-650001cc-75f0-475b-af92-6490427cff33 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:53 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-0ca716fb-894a-44ce-8085-70741df421f1 req-650001cc-75f0-475b-af92-6490427cff33 tempest-TestInstancesWithCinderVolumes-471447094 None] Terminate volume connection completed successfully.
Sep 27 11:34:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-0ca716fb-894a-44ce-8085-70741df421f1 req-650001cc-75f0-475b-af92-6490427cff33 tempest-TestInstancesWithCinderVolumes-471447094 None] Deleting attachment 1d0473db-ebdc-401a-af9c-530c719cdc83. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:34:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "cinder-6928ac28-56f8-4fcf-8920-d615da97d768-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-6928ac28-56f8-4fcf-8920-d615da97d768-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:55 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:34:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "cinder-quobyte-6928ac28-56f8-4fcf-8920-d615da97d768" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:34:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-quobyte-6928ac28-56f8-4fcf-8920-d615da97d768" acquired by "delete_volume" :: waited 0.029s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:34:55 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[327ef220-b1bd-4dce-b1d8-5d7bdd75da74]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:34:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:56 devstack quobyte-client[84221]: System call of process 92775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:56 devstack quobyte-client[84221]: System call of process 92775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:56 devstack quobyte-client[84221]: System call of process 92775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:34:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768" returned: 0 in 1.075s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6928ac28-56f8-4fcf-8920-d615da97d768" returned: 0 in 0.175s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-quobyte-6928ac28-56f8-4fcf-8920-d615da97d768" released by "delete_volume" :: held 1.597s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:34:57 devstack cinder-volume[84197]: WARNING cinder.quota [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1559320295-1645564382 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1559320295-1645564382, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:34:57 devstack cinder-volume[84197]: WARNING cinder.quota [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1559320295-1645564382 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1559320295-1645564382, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:34:57 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Created reservations ['fb1ad889-69a3-4f4f-85a3-cf83671c0452', 'a3d663cc-cc75-46d2-9ffe-db578d973378', '92957eef-fc86-4331-ac97-3405b22bc851', '2f883734-65dd-4c62-b11e-1810634c63f8'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:34:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:34:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:34:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:34:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:34:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:34:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:34:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.221s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:34:58 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:34:58 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Deleted volume successfully.
Sep 27 11:34:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1c4f586a-7191-4a1e-9fa8-9e74eccf4cc8 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-6928ac28-56f8-4fcf-8920-d615da97d768-delete_volume" released by "delete_volume" :: held 3.625s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:00 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:35:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Flow 'volume_create_manager' (0b3032e2-b442-4c65-8992-5fc09b4336d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:35:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b0c979-563f-49e5-9449-7180435a48ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b0c979-563f-49e5-9449-7180435a48ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1485360608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6aba89-ed82-4224-b251-d268db29e0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3456e023c547e6bb54ca50291fbb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:35:01Z,use_quota=True,user_id='44c5b2163047459395b62e22a20946e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e0a6f0-3344-4bb6-913a-92ef7c68bc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e0a6f0-3344-4bb6-913a-92ef7c68bc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27c7b5f-b3cd-4fbb-9777-9cbcb8efe381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27c7b5f-b3cd-4fbb-9777-9cbcb8efe381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6aba89-ed82-4224-b251-d268db29e0f7', 'volume_name': 'volume-0c6aba89-ed82-4224-b251-d268db29e0f7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f03496-a829-453b-9368-92508c123a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f03496-a829-453b-9368-92508c123a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6002735-780c-4f1b-bd50-e2f3d387c19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:01 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Volume 0c6aba89-ed82-4224-b251-d268db29e0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6aba89-ed82-4224-b251-d268db29e0f7', 'volume_size': 1}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1485360608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6aba89-ed82-4224-b251-d268db29e0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3456e023c547e6bb54ca50291fbb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:35:01Z,use_quota=True,user_id='44c5b2163047459395b62e22a20946e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Creating volume 0c6aba89-ed82-4224-b251-d268db29e0f7 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:35:01 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0c6aba89-ed82-4224-b251-d268db29e0f7 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:01 devstack quobyte-client[84221]: System call of process 92803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:01 devstack quobyte-client[84221]: System call of process 92803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:01 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=67, name=volume-0c6aba89-ed82-4224-b251-d268db29e0f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0c6aba89-ed82-4224-b251-d268db29e0f7 1073741824" returned: 0 in 0.476s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0c6aba89-ed82-4224-b251-d268db29e0f7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0c6aba89-ed82-4224-b251-d268db29e0f7" returned: 0 in 0.177s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] <== create_volume: return (760ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:35:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6002735-780c-4f1b-bd50-e2f3d387c19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6aba89-ed82-4224-b251-d268db29e0f7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91db9392-7f1f-40c9-92f5-2d34de02672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:02 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Volume volume-0c6aba89-ed82-4224-b251-d268db29e0f7 (0c6aba89-ed82-4224-b251-d268db29e0f7): created successfully
Sep 27 11:35:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91db9392-7f1f-40c9-92f5-2d34de02672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Flow 'volume_create_manager' (0b3032e2-b442-4c65-8992-5fc09b4336d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:35:02 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-66cbd257-1eae-47ed-a8c5-7257618e9748 tempest-VolumesTransfersTest-985081267 None] Created volume successfully.
Sep 27 11:35:04 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-81942c54-1f8f-4d7b-b3f6-7f806cb9ed01 tempest-VolumesTransfersTest-1700805430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-81942c54-1f8f-4d7b-b3f6-7f806cb9ed01 tempest-VolumesTransfersTest-1700805430 None] Transfer volume completed successfully.
Sep 27 11:35:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Acquiring lock "cinder-0c6aba89-ed82-4224-b251-d268db29e0f7-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Lock "cinder-0c6aba89-ed82-4224-b251-d268db29e0f7-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:05 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Acquiring lock "cinder-quobyte-0c6aba89-ed82-4224-b251-d268db29e0f7" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Lock "cinder-quobyte-0c6aba89-ed82-4224-b251-d268db29e0f7" acquired by "delete_volume" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:05 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[7735ecce-d4ac-417f-8663-ade3f82d0a08]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0c6aba89-ed82-4224-b251-d268db29e0f7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:06 devstack quobyte-client[84221]: System call of process 92832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0c6aba89-ed82-4224-b251-d268db29e0f7" returned: 0 in 0.587s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0c6aba89-ed82-4224-b251-d268db29e0f7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0c6aba89-ed82-4224-b251-d268db29e0f7" returned: 0 in 0.198s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Lock "cinder-quobyte-0c6aba89-ed82-4224-b251-d268db29e0f7" released by "delete_volume" :: held 1.099s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Created reservations ['1309f3d4-ad0f-45d3-b49e-7b655eacf19b', '5275574e-c273-4cc6-a676-0100ef62dfcd', '91c8c3c1-8deb-402b-96e0-e3ddc3d2b37e', '0a39bedd-e24f-40e5-9444-0a25325c3621'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.102s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:35:07 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Deleted volume successfully.
Sep 27 11:35:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9ae99a55-ce62-4dcf-a46d-60613fa9e6e7 tempest-VolumesTransfersTest-1251916246 None] Lock "cinder-0c6aba89-ed82-4224-b251-d268db29e0f7-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:08 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Flow 'volume_create_manager' (d6261f9c-f9c9-463b-a95a-8029f7312135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bc31ef-f01b-4566-a052-1ddc29fe5d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bc31ef-f01b-4566-a052-1ddc29fe5d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1805474728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e1fb43-d933-4fcc-b462-d9e57cbe7b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3456e023c547e6bb54ca50291fbb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:35:08Z,use_quota=True,user_id='44c5b2163047459395b62e22a20946e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506a3c0f-0dab-4666-a2d0-1dba5a4effe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506a3c0f-0dab-4666-a2d0-1dba5a4effe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245d6ecd-6404-4970-9435-96c712163aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245d6ecd-6404-4970-9435-96c712163aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e1fb43-d933-4fcc-b462-d9e57cbe7b96', 'volume_name': 'volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341eb90a-a508-4a5d-b5ed-e698f6569ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341eb90a-a508-4a5d-b5ed-e698f6569ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6d94b0-e0e1-4044-9007-ad74e1b11354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:08 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Volume e8e1fb43-d933-4fcc-b462-d9e57cbe7b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96', 'volume_size': 1}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1805474728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e1fb43-d933-4fcc-b462-d9e57cbe7b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3456e023c547e6bb54ca50291fbb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:35:08Z,use_quota=True,user_id='44c5b2163047459395b62e22a20946e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Creating volume e8e1fb43-d933-4fcc-b462-d9e57cbe7b96 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:35:08 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:35:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:09 devstack quobyte-client[84221]: System call of process 92841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:09 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=68, name=volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:35:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96 1073741824" returned: 0 in 0.383s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96" returned: 0 in 0.153s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] <== create_volume: return (614ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:35:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.626s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6d94b0-e0e1-4044-9007-ad74e1b11354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cc548f-d307-4945-bb93-4df323610e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:09 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Volume volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96 (e8e1fb43-d933-4fcc-b462-d9e57cbe7b96): created successfully
Sep 27 11:35:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cc548f-d307-4945-bb93-4df323610e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Flow 'volume_create_manager' (d6261f9c-f9c9-463b-a95a-8029f7312135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:35:09 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c8373fd0-07d3-46b3-835c-be91f73da852 tempest-VolumesTransfersTest-985081267 None] Created volume successfully.
Sep 27 11:35:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Acquiring lock "cinder-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Lock "cinder-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:11 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Acquiring lock "cinder-quobyte-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Lock "cinder-quobyte-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96" acquired by "delete_volume" :: waited 0.038s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:11 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e221c0e1-4883-45c2-9fa7-7b2f963e21c7]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96" returned: 0 in 0.449s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96" returned: 0 in 0.109s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Lock "cinder-quobyte-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96" released by "delete_volume" :: held 0.778s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Created reservations ['525f3496-8576-4eb8-a8d0-1e63c4c13727', '4299f000-b68b-46cc-a239-273235665282', '93f37b31-12aa-4851-878a-79c79af52b4e', '9911f6b0-e33b-4d36-9cbc-64cf907db8c1'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.117s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:12 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:35:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Deleted volume successfully.
Sep 27 11:35:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d0118d3-d081-40d4-bf03-f2ea326aabbe tempest-VolumesTransfersTest-1251916246 None] Lock "cinder-e8e1fb43-d933-4fcc-b462-d9e57cbe7b96-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:22 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=38,cinder:UPDATE=60,cinder:DELETE=2,cinder:INSERT=10 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:35:23 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=42,cinder:SELECT=31,cinder:INSERT=14,cinder:DELETE=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:35:25 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:25 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:35:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Flow 'volume_create_manager' (b4657062-a7fc-46a7-b735-38bea89cefc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:35:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a7e806-2b38-4dc9-85b4-08f7d9f987e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a7e806-2b38-4dc9-85b4-08f7d9f987e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1110060455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e62670-804a-4b71-811e-95d493827771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a0d71e0b8440079741500db7e6db74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:35:25Z,use_quota=True,user_id='0f6330660cf14e1aa4c3a7d8349c68c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e14ff5-ca8f-4689-99ce-73b1e1f1702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e14ff5-ca8f-4689-99ce-73b1e1f1702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af595f0-02f9-48a6-903c-7ea27efac373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:25 devstack cinder-volume[84197]: DEBUG cinder.image.glance [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Creating Keystone auth plugin from conf {{(pid=84197) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 27 11:35:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af595f0-02f9-48a6-903c-7ea27efac373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '72e62670-804a-4b71-811e-95d493827771', 'volume_name': 'volume-72e62670-804a-4b71-811e-95d493827771', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce52e6b8b0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afcba81-7739-44d1-b4e4-1235445aabb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afcba81-7739-44d1-b4e4-1235445aabb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff95efc6-208e-494f-a7a2-e04b0319e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:26 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Volume 72e62670-804a-4b71-811e-95d493827771: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-72e62670-804a-4b71-811e-95d493827771', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce52e6b8b0>}
Sep 27 11:35:26 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Cloning 72e62670-804a-4b71-811e-95d493827771 from image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3  at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]). {{(pid=84197) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 27 11:35:26 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 27 11:35:26 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Image download 20.69 MB at 20.69 MB/s
Sep 27 11:35:26 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3b31e6-7a7e-4836-8daf-03d1d132a802]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-c3561fad-2dd2-4733-be91-4c85a3e8bf36 req-5ea7d552-be98-4f66-8463-8b3a9397ad90 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "cinder-a7308368-5b7f-45e4-aa69-87176d1209ef-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:27 devstack sudo[92934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD
Sep 27 11:35:27 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:35:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-c3561fad-2dd2-4733-be91-4c85a3e8bf36 req-5ea7d552-be98-4f66-8463-8b3a9397ad90 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:27 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-c3561fad-2dd2-4733-be91-4c85a3e8bf36 req-5ea7d552-be98-4f66-8463-8b3a9397ad90 tempest-TestInstancesWithCinderVolumes-471447094 None] Terminate volume connection completed successfully.
Sep 27 11:35:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-c3561fad-2dd2-4733-be91-4c85a3e8bf36 req-5ea7d552-be98-4f66-8463-8b3a9397ad90 tempest-TestInstancesWithCinderVolumes-471447094 None] Deleting attachment b51f7168-3782-481c-8164-fa713cf3fda0. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:35:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "cinder-a7308368-5b7f-45e4-aa69-87176d1209ef-delete_volume" acquired by "delete_volume" :: waited 0.211s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "cinder-quobyte-a7308368-5b7f-45e4-aa69-87176d1209ef" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "cinder-quobyte-a7308368-5b7f-45e4-aa69-87176d1209ef" acquired by "delete_volume" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6316269-01a8-4c85-abcf-c33b8a2a5efb]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a7308368-5b7f-45e4-aa69-87176d1209ef {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:28 devstack quobyte-client[84221]: System call of process 92937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:28 devstack quobyte-client[84221]: System call of process 92937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:28 devstack quobyte-client[84221]: System call of process 92937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a7308368-5b7f-45e4-aa69-87176d1209ef" returned: 0 in 0.637s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a7308368-5b7f-45e4-aa69-87176d1209ef {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a7308368-5b7f-45e4-aa69-87176d1209ef" returned: 0 in 0.195s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "cinder-quobyte-a7308368-5b7f-45e4-aa69-87176d1209ef" released by "delete_volume" :: held 1.122s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:29 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Created reservations ['2fa4eb10-4aa3-47c5-9493-a2428603cfbe', 'af57d62b-7ed8-4926-96c9-2f1b868f6b7c', 'c2b57113-5d81-4aea-a8b0-fda9b29c753b', 'c50c49c9-6b2e-4a44-8456-fd4532f54cb9'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:35:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:29 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "cinder-6fee5502-5b13-4e84-8cc8-36fc88e5681f-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD" returned: 0 in 3.479s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "cinder-0d8e8709-5a13-46a9-a933-f3507bea6ec4-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Temporary image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 is fetched for user 0f6330660cf14e1aa4c3a7d8349c68c2. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.598s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-6fee5502-5b13-4e84-8cc8-36fc88e5681f-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:35:30 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Deleted volume successfully.
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "cinder-0d8e8709-5a13-46a9-a933-f3507bea6ec4-delete_volume" acquired by "delete_volume" :: waited 0.365s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-733276cc-4976-4fdb-b0ae-7c866f5d6079 tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "cinder-a7308368-5b7f-45e4-aa69-87176d1209ef-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "cinder-quobyte-6fee5502-5b13-4e84-8cc8-36fc88e5681f" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-quobyte-6fee5502-5b13-4e84-8cc8-36fc88e5681f" acquired by "delete_volume" :: waited 0.033s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "cinder-quobyte-0d8e8709-5a13-46a9-a933-f3507bea6ec4" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc5fa6c-8589-481e-8283-da0893d99e15]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "cinder-quobyte-0d8e8709-5a13-46a9-a933-f3507bea6ec4" acquired by "delete_volume" :: waited 0.414s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:31 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb1f490-783d-4e6c-a4c8-e4ac179d5ed8]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:31 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb734a5a-4cdd-4811-952a-fac057aa2026]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:31 devstack quobyte-client[84221]: System call of process 92946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:31 devstack quobyte-client[84221]: System call of process 92946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:31 devstack quobyte-client[84221]: System call of process 92946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f" returned: 0 in 0.973s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:31 devstack quobyte-client[84221]: System call of process 92947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fee5502-5b13-4e84-8cc8-36fc88e5681f" returned: 0 in 0.190s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:32 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-quobyte-6fee5502-5b13-4e84-8cc8-36fc88e5681f" released by "delete_volume" :: held 1.407s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:32 devstack sudo[92948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD
Sep 27 11:35:32 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:35:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4" returned: 0 in 1.099s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:33 devstack cinder-volume[84197]: WARNING cinder.quota [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1007719827-1140504099 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1007719827-1140504099, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:35:33 devstack cinder-volume[84197]: WARNING cinder.quota [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1007719827-1140504099 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1007719827-1140504099, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:35:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0d8e8709-5a13-46a9-a933-f3507bea6ec4" returned: 0 in 0.700s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "cinder-quobyte-0d8e8709-5a13-46a9-a933-f3507bea6ec4" released by "delete_volume" :: held 2.048s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:33 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Created reservations ['f69957c2-b6bd-4267-9b02-eace436de632', '0c47784d-0c85-49e1-ac88-a511126b9d43', '5aa92b79-3eac-4711-99b0-922a475954ae', 'a3fb12b1-04b0-4699-a56d-3bc36e3ca463'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:35:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.435s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:34 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:35:34 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Deleted volume successfully.
Sep 27 11:35:34 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Created reservations ['22028650-8441-4ed3-a12c-2ab67570d064', '90eacbe7-5cd6-4728-b252-90990336333c', '3260c530-ac0a-4389-82bf-9e64901655eb', '160df335-c135-4471-b5c1-d2dc0cab9119'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:35:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c4e5fcd3-1609-46e5-9e0a-bcea49d1b263 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-6fee5502-5b13-4e84-8cc8-36fc88e5681f-delete_volume" released by "delete_volume" :: held 4.767s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.227s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:35 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:35:35 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Deleted volume successfully.
Sep 27 11:35:36 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7358e5fd-8fab-4c87-9e2c-d89f524da4af tempest-AttachVolumeShelveTestJSON-952316277 None] Lock "cinder-0d8e8709-5a13-46a9-a933-f3507bea6ec4-delete_volume" released by "delete_volume" :: held 5.974s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:37 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD" returned: 0 in 6.278s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1110060455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e62670-804a-4b71-811e-95d493827771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a0d71e0b8440079741500db7e6db74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:35:25Z,use_quota=True,user_id='0f6330660cf14e1aa4c3a7d8349c68c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Creating volume 72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:35:37 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:35:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:38 devstack quobyte-client[84221]: System call of process 93007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:38 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=69, name=volume-72e62670-804a-4b71-811e-95d493827771, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:35:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 1073741824" returned: 0 in 0.831s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771" returned: 0 in 0.141s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] <== create_volume: return (1118ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:35:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Attempting download of 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}])) to volume 72e62670-804a-4b71-811e-95d493827771. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.738s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:35:40 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[817aba54-d0e2-4809-989b-fad8a5618a5f]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_zb9vikgn {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_zb9vikgn" returned: 0 in 0.595s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_zb9vikgn {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-887c860e-b7db-4493-8750-2a47b80b74cb req-f5f61040-c8e1-405d-8da6-aa2e4cc09299 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-887c860e-b7db-4493-8750-2a47b80b74cb req-f5f61040-c8e1-405d-8da6-aa2e4cc09299 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:41 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-887c860e-b7db-4493-8750-2a47b80b74cb req-f5f61040-c8e1-405d-8da6-aa2e4cc09299 tempest-TestInstancesWithCinderVolumes-471447094 None] Terminate volume connection completed successfully.
Sep 27 11:35:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-887c860e-b7db-4493-8750-2a47b80b74cb req-f5f61040-c8e1-405d-8da6-aa2e4cc09299 tempest-TestInstancesWithCinderVolumes-471447094 None] Deleting attachment b45fe851-32db-4566-a22c-293c942f751e. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:35:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_zb9vikgn" returned: 1 in 1.046s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_zb9vikgn' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:35:41 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b42fff1-52a1-4e9d-8b82-0eb59cfebcbf]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:42 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 was qcow2, converting to raw {{(pid=84197) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 27 11:35:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:42 devstack quobyte-client[84221]: System call of process 93023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:42 devstack quobyte-client[84221]: System call of process 93023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:42 devstack quobyte-client[84221]: System call of process 93023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:42 devstack quobyte-client[84221]: System call of process 93023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:42 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=69, name=volume-72e62670-804a-4b71-811e-95d493827771, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:35:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771" returned: 0 in 1.412s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:43 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_mfjo7br3devstack@QuobyteHD, size 112.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:35:43 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Converted 112.00 MB image at 77.56 MB/s
Sep 27 11:35:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:44 devstack quobyte-client[84221]: System call of process 93029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:44 devstack quobyte-client[84221]: System call of process 93029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 1G" returned: 0 in 0.180s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:44 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e6dd2-65bf-44a7-af22-d137982ae33b]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771" returned: 0 in 0.523s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771" returned: 1 in 0.728s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:35:45 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Downloaded image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}])) to volume 72e62670-804a-4b71-811e-95d493827771 successfully. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 27 11:35:45 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Temporary image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 for user 0f6330660cf14e1aa4c3a7d8349c68c2 is deleted. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 27 11:35:45 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Marking volume 72e62670-804a-4b71-811e-95d493827771 as bootable. {{(pid=84197) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "cinder-17165a91-d16d-47c4-beab-6b4a7dae2fad-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Copying metadata from image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 to 72e62670-804a-4b71-811e-95d493827771. {{(pid=84197) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Creating volume glance metadata for volume 72e62670-804a-4b71-811e-95d493827771 backed by image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84197) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-17165a91-d16d-47c4-beab-6b4a7dae2fad-delete_volume" acquired by "delete_volume" :: waited 0.250s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:46 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "cinder-quobyte-17165a91-d16d-47c4-beab-6b4a7dae2fad" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff95efc6-208e-494f-a7a2-e04b0319e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e62670-804a-4b71-811e-95d493827771', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce52e6b8b0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d233a5-f894-4a5b-a878-cf1b93a164bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-quobyte-17165a91-d16d-47c4-beab-6b4a7dae2fad" acquired by "delete_volume" :: waited 0.076s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:46 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Volume volume-72e62670-804a-4b71-811e-95d493827771 (72e62670-804a-4b71-811e-95d493827771): created successfully
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d233a5-f894-4a5b-a878-cf1b93a164bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Flow 'volume_create_manager' (b4657062-a7fc-46a7-b735-38bea89cefc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:35:46 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-40a9852a-a568-43ae-91df-7365aac7b544 tempest-VolumesExtendTest-431914130 None] Created volume successfully.
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[6defd29e-cc18-4c05-b8a4-ffd44b8a0d19]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad" returned: 0 in 0.567s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:48 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:48 devstack quobyte-client[84221]: System call of process 93073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:48 devstack quobyte-client[84221]: System call of process 93073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:48 devstack quobyte-client[84221]: System call of process 93073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:48 devstack quobyte-client[84221]: System call of process 93073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad" returned: 1 in 0.654s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d0254-0dc6-4763-a69c-2b0d7706f9b1]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-17165a91-d16d-47c4-beab-6b4a7dae2fad" returned: 0 in 0.384s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-quobyte-17165a91-d16d-47c4-beab-6b4a7dae2fad" released by "delete_volume" :: held 1.904s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:48 devstack cinder-volume[84197]: WARNING cinder.quota [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-725587706-2023375847 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-725587706-2023375847, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:35:48 devstack cinder-volume[84197]: WARNING cinder.quota [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-725587706-2023375847 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-725587706-2023375847, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Created reservations ['a775c9af-c57c-4c7a-bcc6-2a2e7a278cb4', '991b5cf7-aa74-43a2-8eaa-29d88f3193fa', '9a780485-7dbb-4e5d-ba69-67ee856718d9', '07e8d7ed-a705-469b-b832-e40e027328c3'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:35:48 devstack quobyte-client[84221]: System call of process 93077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:48 devstack quobyte-client[84221]: System call of process 93077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771" returned: 0 in 0.724s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:49 devstack quobyte-client[84221]: System call of process 93079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:49 devstack quobyte-client[84221]: System call of process 93079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:49 devstack quobyte-client[84221]: System call of process 93079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771" returned: 1 in 0.665s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:35:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 2G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:50 devstack quobyte-client[84221]: System call of process 93082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:50 devstack quobyte-client[84221]: System call of process 93082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:50 devstack quobyte-client[84221]: System call of process 93082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:50 devstack quobyte-client[84221]: System call of process 93082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 2G" returned: 0 in 0.548s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.279s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.588s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:35:50 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Deleted volume successfully.
Sep 27 11:35:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-645fa87d-49df-4570-b92a-f92778249795 tempest-TestInstancesWithCinderVolumes-471447094 None] Lock "cinder-17165a91-d16d-47c4-beab-6b4a7dae2fad-delete_volume" released by "delete_volume" :: held 4.452s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:50 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-5bfea5cd-bb70-4355-baf1-b9782f66f371 tempest-VolumesExtendTest-431914130 None] Extend volume completed successfully.
Sep 27 11:35:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Acquiring lock "cinder-72e62670-804a-4b71-811e-95d493827771-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Lock "cinder-72e62670-804a-4b71-811e-95d493827771-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:52 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Acquiring lock "cinder-quobyte-72e62670-804a-4b71-811e-95d493827771" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:35:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Lock "cinder-quobyte-72e62670-804a-4b71-811e-95d493827771" acquired by "delete_volume" :: waited 0.025s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:35:52 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8df5fe-3633-404d-8c22-bb4cb7f930a8]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771" returned: 0 in 0.594s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:53 devstack quobyte-client[84221]: System call of process 93090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771" returned: 1 in 0.662s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:35:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-72e62670-804a-4b71-811e-95d493827771" returned: 0 in 0.166s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Lock "cinder-quobyte-72e62670-804a-4b71-811e-95d493827771" released by "delete_volume" :: held 1.804s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:54 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Created reservations ['3db1b62f-3e9b-4385-9444-e096e55729ec', '79565f9a-956b-4df5-a645-3185a268bdc5', '9c3f0b6a-b377-4ba9-a97b-bd5b8bb6bcb7', '98a54db3-f8fa-4c85-8bdb-585b868bf1f3'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:35:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.202s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:55 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:35:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Deleted volume successfully.
Sep 27 11:35:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8aef13df-4764-4188-b10a-f3dc7ff736b8 tempest-VolumesExtendTest-431914130 None] Lock "cinder-72e62670-804a-4b71-811e-95d493827771-delete_volume" released by "delete_volume" :: held 3.930s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:35:56 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Flow 'volume_create_manager' (a1f5d589-8cdb-40e7-b593-4adf015256bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca36a00c-9695-45f6-b11e-fc377fc4f975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca36a00c-9695-45f6-b11e-fc377fc4f975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1013349291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd246da-7fce-4de4-a5be-7fe23926c858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a0d71e0b8440079741500db7e6db74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:35:56Z,use_quota=True,user_id='0f6330660cf14e1aa4c3a7d8349c68c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c06503-1eca-4ec8-b7a3-ea1377945e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c06503-1eca-4ec8-b7a3-ea1377945e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fc3d81-3e2c-4461-a27b-8fa5df4efd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fc3d81-3e2c-4461-a27b-8fa5df4efd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd246da-7fce-4de4-a5be-7fe23926c858', 'volume_name': 'volume-9bd246da-7fce-4de4-a5be-7fe23926c858', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb838335-0827-464e-ac5d-d8a86975b2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb838335-0827-464e-ac5d-d8a86975b2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75d4ee7-b22b-4641-9171-de333879867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:56 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Volume 9bd246da-7fce-4de4-a5be-7fe23926c858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd246da-7fce-4de4-a5be-7fe23926c858', 'volume_size': 1}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1013349291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd246da-7fce-4de4-a5be-7fe23926c858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a0d71e0b8440079741500db7e6db74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:35:56Z,use_quota=True,user_id='0f6330660cf14e1aa4c3a7d8349c68c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Creating volume 9bd246da-7fce-4de4-a5be-7fe23926c858 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:35:56 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:35:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:57 devstack quobyte-client[84221]: System call of process 93100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:57 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=70, name=volume-9bd246da-7fce-4de4-a5be-7fe23926c858, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:35:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 1073741824" returned: 0 in 0.490s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858" returned: 0 in 0.164s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:35:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] <== create_volume: return (760ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:35:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:35:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75d4ee7-b22b-4641-9171-de333879867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd246da-7fce-4de4-a5be-7fe23926c858', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2556035-17c3-4d1b-aa33-a6e9f2bbb53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:35:58 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Volume volume-9bd246da-7fce-4de4-a5be-7fe23926c858 (9bd246da-7fce-4de4-a5be-7fe23926c858): created successfully
Sep 27 11:35:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2556035-17c3-4d1b-aa33-a6e9f2bbb53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:35:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Flow 'volume_create_manager' (a1f5d589-8cdb-40e7-b593-4adf015256bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:35:58 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-d5845db0-88dd-4e33-9efb-04b1f442782a tempest-VolumesExtendTest-431914130 None] Created volume successfully.
Sep 27 11:35:59 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:35:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:35:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:35:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Creating offline snapshot 9123cc9c-57b3-4387-b49f-2b40a50b9263 of volume 9bd246da-7fce-4de4-a5be-7fe23926c858 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:35:59 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[23982612-79e9-4f98-abfd-5951aa54b3cf]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:35:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:35:59 devstack quobyte-client[84221]: System call of process 93104 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:35:59 devstack quobyte-client[84221]: System call of process 93104 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858" returned: 0 in 0.731s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:00 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=71, name=volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:36:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 1G" returned: 0 in 0.416s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9bd246da-7fce-4de4-a5be-7fe23926c858 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:00 devstack quobyte-client[84221]: System call of process 93110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] CMD "qemu-img rebase -u -b volume-9bd246da-7fce-4de4-a5be-7fe23926c858 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263" returned: 0 in 0.233s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:36:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263" returned: 0 in 0.161s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263" returned: 0 in 0.147s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.info" returned: 0 in 0.176s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.info" returned: 0 in 0.158s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:02 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-24bebbf2-68cb-4f52-a15d-c54c7a7682d5 tempest-VolumesExtendTest-431914130 None] Create snapshot completed successfully
Sep 27 11:36:02 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ed8c891c-28fe-42e6-9a64-ab562c061181 tempest-VolumesExtendTest-431914130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ed8c891c-28fe-42e6-9a64-ab562c061181 tempest-VolumesExtendTest-431914130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ed8c891c-28fe-42e6-9a64-ab562c061181 tempest-VolumesExtendTest-431914130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:02 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa0cbc9-6be3-40f1-9381-b51a0670a732]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed8c891c-28fe-42e6-9a64-ab562c061181 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:03 devstack quobyte-client[84221]: System call of process 93118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:03 devstack quobyte-client[84221]: System call of process 93118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:03 devstack quobyte-client[84221]: System call of process 93118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed8c891c-28fe-42e6-9a64-ab562c061181 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858" returned: 0 in 0.967s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed8c891c-28fe-42e6-9a64-ab562c061181 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 2G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:04 devstack quobyte-client[84221]: System call of process 93121 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:04 devstack quobyte-client[84221]: System call of process 93121 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed8c891c-28fe-42e6-9a64-ab562c061181 tempest-VolumesExtendTest-431914130 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 2G" returned: 0 in 0.286s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ed8c891c-28fe-42e6-9a64-ab562c061181 tempest-VolumesExtendTest-431914130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.444s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ed8c891c-28fe-42e6-9a64-ab562c061181 tempest-VolumesExtendTest-431914130 None] Extend volume completed successfully.
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Acquiring lock "cinder-9123cc9c-57b3-4387-b49f-2b40a50b9263-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Lock "cinder-9123cc9c-57b3-4387-b49f-2b40a50b9263-delete_snapshot" acquired by "delete_snapshot" :: waited 0.146s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:05 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Acquiring lock "cinder-quobyte-9bd246da-7fce-4de4-a5be-7fe23926c858" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Lock "cinder-quobyte-9bd246da-7fce-4de4-a5be-7fe23926c858" acquired by "delete_snapshot" :: waited 0.046s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Acquiring lock "cinder-quobyte-9123cc9c-57b3-4387-b49f-2b40a50b9263" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Lock "cinder-quobyte-9123cc9c-57b3-4387-b49f-2b40a50b9263" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Deleting offline snapshot 9123cc9c-57b3-4387-b49f-2b40a50b9263 of volume 9bd246da-7fce-4de4-a5be-7fe23926c858 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] snapshot_file for this snap is: volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b28a52-4083-439b-aa32-36fc5ba532e1]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263" returned: 0 in 0.732s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bd246da-7fce-4de4-a5be-7fe23926c858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:36:06 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[282d9f87-7a6c-4ba2-b241-1eb44a4f304c]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858" returned: 0 in 0.550s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:07 devstack quobyte-client[84221]: System call of process 93138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263" returned: 0 in 0.663s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858.9123cc9c-57b3-4387-b49f-2b40a50b9263" returned: 0 in 0.165s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Lock "cinder-quobyte-9123cc9c-57b3-4387-b49f-2b40a50b9263" released by "_delete_snapshot" :: held 2.690s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Lock "cinder-quobyte-9bd246da-7fce-4de4-a5be-7fe23926c858" released by "delete_snapshot" :: held 2.735s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:08 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Created reservations ['2dd461a7-0037-4882-b658-877ab4bf6cc6', 'd4996443-56cf-42cf-a7d0-9f6fd83fdcea', 'd17d96fc-5684-493b-b397-6ed3de21a7ef', 'bed58810-d71e-4748-8009-ce77e71a2ca0'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:36:09 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Delete snapshot completed successfully.
Sep 27 11:36:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d06b6bbc-3571-4025-9882-5aa1114e5a96 tempest-VolumesExtendTest-431914130 None] Lock "cinder-9123cc9c-57b3-4387-b49f-2b40a50b9263-delete_snapshot" released by "delete_snapshot" :: held 3.474s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Acquiring lock "cinder-9bd246da-7fce-4de4-a5be-7fe23926c858-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Lock "cinder-9bd246da-7fce-4de4-a5be-7fe23926c858-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Acquiring lock "cinder-quobyte-9bd246da-7fce-4de4-a5be-7fe23926c858" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Lock "cinder-quobyte-9bd246da-7fce-4de4-a5be-7fe23926c858" acquired by "delete_volume" :: waited 0.025s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:10 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3d8adc-9166-4544-89c9-e7632db57490]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:11 devstack quobyte-client[84221]: System call of process 93143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:11 devstack quobyte-client[84221]: System call of process 93143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:11 devstack quobyte-client[84221]: System call of process 93143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858" returned: 0 in 0.924s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9bd246da-7fce-4de4-a5be-7fe23926c858" returned: 0 in 0.278s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Lock "cinder-quobyte-9bd246da-7fce-4de4-a5be-7fe23926c858" released by "delete_volume" :: held 1.646s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Created reservations ['c95896e9-2773-44ac-95e1-694d9a5ecd98', 'be4d8e66-695f-4852-99c0-2ba8691fe47a', '916d060b-7ed9-4afb-8035-7661053ec8a6', 'a4dd88fc-654e-4518-a993-686614feccef'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.133s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:12 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:36:13 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Deleted volume successfully.
Sep 27 11:36:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4c7bc7ac-c495-4ef0-8a0a-f75c0707d3a4 tempest-VolumesExtendTest-431914130 None] Lock "cinder-9bd246da-7fce-4de4-a5be-7fe23926c858-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:19 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (30414d95-b789-4b5b-b8b7-eb12cf85ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542cc709-be69-4f4f-9747-02e9c317b4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542cc709-be69-4f4f-9747-02e9c317b4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943610758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2336127b-dc59-4815-bb8d-d05cf559e219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:19Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417c0382-85a7-452a-bd41-ac1c901e7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417c0382-85a7-452a-bd41-ac1c901e7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6392ff-026e-4cc9-a0e8-4cfba9aa7e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6392ff-026e-4cc9-a0e8-4cfba9aa7e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2336127b-dc59-4815-bb8d-d05cf559e219', 'volume_name': 'volume-2336127b-dc59-4815-bb8d-d05cf559e219', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3683ca3-04e0-4665-a97e-af3555772f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3683ca3-04e0-4665-a97e-af3555772f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec80c0c-c0de-43fb-916d-d565b54c7702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:19 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume 2336127b-dc59-4815-bb8d-d05cf559e219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2336127b-dc59-4815-bb8d-d05cf559e219', 'volume_size': 1}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943610758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2336127b-dc59-4815-bb8d-d05cf559e219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:19Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Creating volume 2336127b-dc59-4815-bb8d-d05cf559e219 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:36:19 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:36:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:19 devstack quobyte-client[84221]: System call of process 93150 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:19 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=73, name=volume-2336127b-dc59-4815-bb8d-d05cf559e219, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:36:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 1073741824" returned: 0 in 0.428s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219" returned: 0 in 0.146s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] <== create_volume: return (652ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:36:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec80c0c-c0de-43fb-916d-d565b54c7702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2336127b-dc59-4815-bb8d-d05cf559e219', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e22385-30d5-40cc-9727-8a94cd701253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:20 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume volume-2336127b-dc59-4815-bb8d-d05cf559e219 (2336127b-dc59-4815-bb8d-d05cf559e219): created successfully
Sep 27 11:36:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e22385-30d5-40cc-9727-8a94cd701253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (30414d95-b789-4b5b-b8b7-eb12cf85ff77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-548f661b-9fb9-4906-937f-e0d97c08feed tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created volume successfully.
Sep 27 11:36:22 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=68,cinder:SELECT=49,cinder:INSERT=11,cinder:DELETE=5 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:36:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:23 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=57,cinder:UPDATE=68,cinder:DELETE=5,cinder:INSERT=30 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:36:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Creating offline snapshot d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 of volume 2336127b-dc59-4815-bb8d-d05cf559e219 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:36:23 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d94e000-f804-445f-ba35-61ea833d63d1]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219" returned: 0 in 0.585s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:24 devstack quobyte-client[84221]: System call of process 93157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:24 devstack quobyte-client[84221]: System call of process 93157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:24 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=74, name=volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:36:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 1G" returned: 0 in 0.392s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2336127b-dc59-4815-bb8d-d05cf559e219 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:24 devstack quobyte-client[84221]: System call of process 93161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "qemu-img rebase -u -b volume-2336127b-dc59-4815-bb8d-d05cf559e219 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8" returned: 0 in 0.219s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:36:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8" returned: 0 in 0.198s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:36:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8" returned: 0 in 0.214s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.info" returned: 0 in 0.129s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:36:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.info" returned: 0 in 0.141s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:26 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ff8e85ba-304b-4564-be3b-cdcf4383bd72 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Create snapshot completed successfully
Sep 27 11:36:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (bcf5a7da-3d86-470d-9204-59cc50c5e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dc9cc3-1f25-4f61-b00f-6880bc7a771f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dc9cc3-1f25-4f61-b00f-6880bc7a771f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-611989634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a149e9ff-0baa-4d27-90c4-2ad669bce0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:28Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3ca572-f3bf-4768-88bb-7ce1e1e1903e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3ca572-f3bf-4768-88bb-7ce1e1e1903e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f751f1-9c48-4c99-bcb4-efdde701c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f751f1-9c48-4c99-bcb4-efdde701c532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a149e9ff-0baa-4d27-90c4-2ad669bce0a9', 'volume_name': 'volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6482b59e-995f-46fc-bacd-0228cec6b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6482b59e-995f-46fc-bacd-0228cec6b034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f16cdea-f31f-4f2f-b67f-506807763dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:28 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume a149e9ff-0baa-4d27-90c4-2ad669bce0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9', 'volume_size': 1}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-611989634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a149e9ff-0baa-4d27-90c4-2ad669bce0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:28Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Creating volume a149e9ff-0baa-4d27-90c4-2ad669bce0a9 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:36:28 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:36:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:28 devstack quobyte-client[84221]: System call of process 93180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:29 devstack quobyte-client[84221]: System call of process 93180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:29 devstack quobyte-client[84221]: System call of process 93180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:29 devstack quobyte-client[84221]: System call of process 93180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:29 devstack quobyte-client[84221]: System call of process 93180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:29 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=76, name=volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:36:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9 1073741824" returned: 0 in 0.898s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:29 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (4fe2f1fa-3bc1-4e2b-93f6-c7da4606822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7c3538-84c1-4e4f-97e5-6e068e58b431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7c3538-84c1-4e4f-97e5-6e068e58b431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-857896323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cd4c73-6197-4500-bfb6-54b3c7a22b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:28Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4414aa49-bc5e-4743-9205-d132ec4ad1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4414aa49-bc5e-4743-9205-d132ec4ad1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf7cb71-991f-488c-97b0-bdb0da6a11a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf7cb71-991f-488c-97b0-bdb0da6a11a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8cd4c73-6197-4500-bfb6-54b3c7a22b1b', 'volume_name': 'volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7651ff34-a198-4e68-90f6-34be383e9483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7651ff34-a198-4e68-90f6-34be383e9483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404b1285-ae67-4232-be20-fe3db634b9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:30 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume c8cd4c73-6197-4500-bfb6-54b3c7a22b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b', 'volume_size': 1}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (835095e3-b4f4-43f1-9d3a-3ff32c70ecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fd6abe-fda2-411a-9162-4d3d25e35a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fd6abe-fda2-411a-9162-4d3d25e35a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994987084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723b63eb-acca-4fef-acfd-63388f6a5bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:29Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f73cce-daed-4677-89ba-57da93a9cd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f73cce-daed-4677-89ba-57da93a9cd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf041f0-c9b2-4655-8b12-680ce087514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf041f0-c9b2-4655-8b12-680ce087514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '723b63eb-acca-4fef-acfd-63388f6a5bb4', 'volume_name': 'volume-723b63eb-acca-4fef-acfd-63388f6a5bb4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a98819-5013-4aab-84df-f30156a576bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a98819-5013-4aab-84df-f30156a576bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3a55e-1c05-4a76-86c7-0afb61b0c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:31 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume 723b63eb-acca-4fef-acfd-63388f6a5bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-723b63eb-acca-4fef-acfd-63388f6a5bb4', 'volume_size': 1}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9" returned: 0 in 1.401s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] <== create_volume: return (2372ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.397s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.173s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-857896323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cd4c73-6197-4500-bfb6-54b3c7a22b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:28Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Creating volume c8cd4c73-6197-4500-bfb6-54b3c7a22b1b {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:36:31 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:31 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=77, name=volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f16cdea-f31f-4f2f-b67f-506807763dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3530854-71da-48fc-95e6-521065e9da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:31 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (dfe7c7d6-81a6-4d54-85a2-0d6c1b212914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e20244-c6ec-4a5c-92b7-5489a9e3e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b 1073741824" returned: 0 in 0.777s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:32 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9 (a149e9ff-0baa-4d27-90c4-2ad669bce0a9): created successfully
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3530854-71da-48fc-95e6-521065e9da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (bcf5a7da-3d86-470d-9204-59cc50c5e53d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:32 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (af464a0a-b173-46e1-84b1-394d76b883ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7b23b7-0e90-437e-9fe0-968babdd3b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e20244-c6ec-4a5c-92b7-5489a9e3e883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1949497299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0cf6e8-6115-4383-befe-239db4246c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:30Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e9fc8d-b6ae-440c-85b2-9be70ae3696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e9fc8d-b6ae-440c-85b2-9be70ae3696d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217d8689-76b5-4569-aa74-dac77d4e4cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217d8689-76b5-4569-aa74-dac77d4e4cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0cf6e8-6115-4383-befe-239db4246c35', 'volume_name': 'volume-3e0cf6e8-6115-4383-befe-239db4246c35', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65eaf8c-81d9-462b-9a92-d442e4a4314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65eaf8c-81d9-462b-9a92-d442e4a4314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283b366e-42c2-4c35-89bf-98367f7ba999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:32 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume 3e0cf6e8-6115-4383-befe-239db4246c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0cf6e8-6115-4383-befe-239db4246c35', 'volume_size': 1}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b" returned: 0 in 0.774s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] <== create_volume: return (1580ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.637s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994987084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723b63eb-acca-4fef-acfd-63388f6a5bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:29Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Creating volume 723b63eb-acca-4fef-acfd-63388f6a5bb4 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:36:32 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-723b63eb-acca-4fef-acfd-63388f6a5bb4 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7b23b7-0e90-437e-9fe0-968babdd3b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822553039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b12b04c-7b63-4299-bf4c-029c68676f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:31Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47faa302-643b-4346-9101-eddced1f6afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47faa302-643b-4346-9101-eddced1f6afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dce1bba-e6bf-4c54-883a-d10df6fa1848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dce1bba-e6bf-4c54-883a-d10df6fa1848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b12b04c-7b63-4299-bf4c-029c68676f2e', 'volume_name': 'volume-0b12b04c-7b63-4299-bf4c-029c68676f2e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bc44a7-d11b-40ae-a9e7-2927f55bf84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bc44a7-d11b-40ae-a9e7-2927f55bf84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd40fd1-3e1d-4c0a-8e5d-56755798af88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:32 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume 0b12b04c-7b63-4299-bf4c-029c68676f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b12b04c-7b63-4299-bf4c-029c68676f2e', 'volume_size': 1}
Sep 27 11:36:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:33 devstack quobyte-client[84221]: System call of process 93194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:33 devstack quobyte-client[84221]: System call of process 93194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:33 devstack quobyte-client[84221]: System call of process 93194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-fbef3bd7-9fc6-4834-800a-c887d2656b5b tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created volume successfully.
Sep 27 11:36:33 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=78, name=volume-723b63eb-acca-4fef-acfd-63388f6a5bb4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404b1285-ae67-4232-be20-fe3db634b9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367f6f13-ca51-4f79-9b58-6ea73f781ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:33 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b (c8cd4c73-6197-4500-bfb6-54b3c7a22b1b): created successfully
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367f6f13-ca51-4f79-9b58-6ea73f781ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (4fe2f1fa-3bc1-4e2b-93f6-c7da4606822b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-723b63eb-acca-4fef-acfd-63388f6a5bb4 1073741824" returned: 0 in 0.791s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-723b63eb-acca-4fef-acfd-63388f6a5bb4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f9735cec-63ea-4b69-bd96-38c3e2b03684 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created volume successfully.
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-723b63eb-acca-4fef-acfd-63388f6a5bb4" returned: 0 in 0.414s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] <== create_volume: return (1236ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1949497299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0cf6e8-6115-4383-befe-239db4246c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:30Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Creating volume 3e0cf6e8-6115-4383-befe-239db4246c35 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:36:33 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:36:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3e0cf6e8-6115-4383-befe-239db4246c35 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:34 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=79, name=volume-3e0cf6e8-6115-4383-befe-239db4246c35, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:36:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3a55e-1c05-4a76-86c7-0afb61b0c33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-723b63eb-acca-4fef-acfd-63388f6a5bb4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3029b5c-d920-4d1f-af36-f55094a53d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:34 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume volume-723b63eb-acca-4fef-acfd-63388f6a5bb4 (723b63eb-acca-4fef-acfd-63388f6a5bb4): created successfully
Sep 27 11:36:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3029b5c-d920-4d1f-af36-f55094a53d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (835095e3-b4f4-43f1-9d3a-3ff32c70ecd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3e0cf6e8-6115-4383-befe-239db4246c35 1073741824" returned: 0 in 0.797s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3e0cf6e8-6115-4383-befe-239db4246c35 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:34 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-5ac5a4df-511e-4dc8-bc0d-df3ce4cb060f tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created volume successfully.
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3e0cf6e8-6115-4383-befe-239db4246c35" returned: 0 in 0.346s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] <== create_volume: return (1190ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.204s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822553039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b12b04c-7b63-4299-bf4c-029c68676f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d5720b54694297b9a58d41ba761b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:36:31Z,use_quota=True,user_id='bce9ce1fc2d74760be9a4dd47df837d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Creating volume 0b12b04c-7b63-4299-bf4c-029c68676f2e {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:36:35 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b12b04c-7b63-4299-bf4c-029c68676f2e 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:35 devstack quobyte-client[84221]: System call of process 93203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:35 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=80, name=volume-0b12b04c-7b63-4299-bf4c-029c68676f2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283b366e-42c2-4c35-89bf-98367f7ba999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0cf6e8-6115-4383-befe-239db4246c35', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a717497-5f77-46d5-ad08-d294bcbec33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:36 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume volume-3e0cf6e8-6115-4383-befe-239db4246c35 (3e0cf6e8-6115-4383-befe-239db4246c35): created successfully
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a717497-5f77-46d5-ad08-d294bcbec33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (dfe7c7d6-81a6-4d54-85a2-0d6c1b212914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b12b04c-7b63-4299-bf4c-029c68676f2e 1073741824" returned: 0 in 0.838s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b12b04c-7b63-4299-bf4c-029c68676f2e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:36 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-3ec28e68-0398-4139-b669-2a21146080de tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created volume successfully.
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b12b04c-7b63-4299-bf4c-029c68676f2e" returned: 0 in 0.393s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] <== create_volume: return (1276ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd40fd1-3e1d-4c0a-8e5d-56755798af88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b12b04c-7b63-4299-bf4c-029c68676f2e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa16aac-89f9-4198-b3f2-6c9fe11788c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:36:36 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume volume-0b12b04c-7b63-4299-bf4c-029c68676f2e (0b12b04c-7b63-4299-bf4c-029c68676f2e): created successfully
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa16aac-89f9-4198-b3f2-6c9fe11788c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:36:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Flow 'volume_create_manager' (af464a0a-b173-46e1-84b1-394d76b883ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:36:36 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0ecb6e9a-5777-4dd4-a541-c7112a8467cd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created volume successfully.
Sep 27 11:36:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-0b12b04c-7b63-4299-bf4c-029c68676f2e-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-0b12b04c-7b63-4299-bf4c-029c68676f2e-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:38 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-quobyte-0b12b04c-7b63-4299-bf4c-029c68676f2e" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-0b12b04c-7b63-4299-bf4c-029c68676f2e" acquired by "delete_volume" :: waited 0.022s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:38 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e70659-8b66-460e-891d-99449db92f7a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b12b04c-7b63-4299-bf4c-029c68676f2e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b12b04c-7b63-4299-bf4c-029c68676f2e" returned: 0 in 0.588s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b12b04c-7b63-4299-bf4c-029c68676f2e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b12b04c-7b63-4299-bf4c-029c68676f2e" returned: 0 in 0.308s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.232s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:36:39 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-0b12b04c-7b63-4299-bf4c-029c68676f2e" released by "delete_volume" :: held 1.599s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:40 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created reservations ['aa86e31f-27d5-42ce-9d22-1af1a55c32a9', 'ee5cf56a-ebd7-4db5-ae9c-24a143ca32f6', '0c743284-185d-4357-b77b-b579d4e4c81e', '3baa3d58-ab28-4dd5-9435-1b7ad90f1586'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:36:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.338s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:41 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:36:41 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Deleted volume successfully.
Sep 27 11:36:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-3e0cf6e8-6115-4383-befe-239db4246c35-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-17414d61-a99f-4394-a94c-8f8273122cc5 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-0b12b04c-7b63-4299-bf4c-029c68676f2e-delete_volume" released by "delete_volume" :: held 4.738s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-3e0cf6e8-6115-4383-befe-239db4246c35-delete_volume" acquired by "delete_volume" :: waited 0.269s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:42 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-quobyte-3e0cf6e8-6115-4383-befe-239db4246c35" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-3e0cf6e8-6115-4383-befe-239db4246c35" acquired by "delete_volume" :: waited 0.037s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:43 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de4e746-58c4-47b7-9bb7-768d909f44bd]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3e0cf6e8-6115-4383-befe-239db4246c35 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:43 devstack quobyte-client[84221]: System call of process 93278 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3e0cf6e8-6115-4383-befe-239db4246c35" returned: 0 in 0.983s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3e0cf6e8-6115-4383-befe-239db4246c35 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-3e0cf6e8-6115-4383-befe-239db4246c35" returned: 0 in 0.362s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-3e0cf6e8-6115-4383-befe-239db4246c35" released by "delete_volume" :: held 1.904s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:45 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created reservations ['03d0cd2c-a9ad-4f81-9cab-041ce4934503', 'c9621d98-d6b5-4810-a63a-1a65ed9aab20', '9ee080a4-6798-4d08-af1f-f550e1632e98', '5d18f252-9e75-4e94-bcdf-f4d29cb2703a'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:36:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-723b63eb-acca-4fef-acfd-63388f6a5bb4-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-723b63eb-acca-4fef-acfd-63388f6a5bb4-delete_volume" acquired by "delete_volume" :: waited 0.365s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 1.784s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:47 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:36:47 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Deleted volume successfully.
Sep 27 11:36:47 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-quobyte-723b63eb-acca-4fef-acfd-63388f6a5bb4" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7c618fb6-35b8-419f-a7ec-7e2fcff88444 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-3e0cf6e8-6115-4383-befe-239db4246c35-delete_volume" released by "delete_volume" :: held 5.460s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-723b63eb-acca-4fef-acfd-63388f6a5bb4" acquired by "delete_volume" :: waited 0.039s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:48 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1063cd13-311f-46ce-b1cd-a458b4878b08]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-723b63eb-acca-4fef-acfd-63388f6a5bb4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:48 devstack quobyte-client[84221]: System call of process 93330 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-723b63eb-acca-4fef-acfd-63388f6a5bb4" returned: 0 in 0.598s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-723b63eb-acca-4fef-acfd-63388f6a5bb4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-723b63eb-acca-4fef-acfd-63388f6a5bb4" returned: 0 in 0.182s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-723b63eb-acca-4fef-acfd-63388f6a5bb4" released by "delete_volume" :: held 1.051s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:49 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created reservations ['fbdbbc44-d43c-463b-bfec-df8434ba7cac', 'a1e77ec0-91d7-4e49-88f2-d3d3b2016b7a', '95660f40-3c10-49bd-9db9-05b5b1e3ff26', '12fde888-4af6-4c25-9c73-d81321cc76a8'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:36:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.377s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:50 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:36:50 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Deleted volume successfully.
Sep 27 11:36:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-06d7e2e1-6399-4ae6-b288-7ad9c41124c0 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-723b63eb-acca-4fef-acfd-63388f6a5bb4-delete_volume" released by "delete_volume" :: held 3.668s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:51 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-quobyte-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b" acquired by "delete_volume" :: waited 0.032s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:51 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d0fcef-8516-4c45-8f02-96db1ba882c0]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:52 devstack quobyte-client[84221]: System call of process 93338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b" returned: 0 in 1.753s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b" returned: 0 in 0.329s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b" released by "delete_volume" :: held 2.617s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:54 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created reservations ['91dfcb8a-5ef2-49c4-b73e-3b89ee10e360', '4b1a811a-0972-49ec-b01a-cd069d93dfd8', '3e771360-2de2-48dd-9aa2-cfefa0c713ee', 'f2c8f299-5fe2-4370-9a50-4e6263eafa92'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:36:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.299s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:55 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:36:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Deleted volume successfully.
Sep 27 11:36:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-a149e9ff-0baa-4d27-90c4-2ad669bce0a9-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-a149e9ff-0baa-4d27-90c4-2ad669bce0a9-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-41a1a2c8-a166-4d3e-a64d-a145c17ffddd tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-c8cd4c73-6197-4500-bfb6-54b3c7a22b1b-delete_volume" released by "delete_volume" :: held 5.232s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:56 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:36:56 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-quobyte-a149e9ff-0baa-4d27-90c4-2ad669bce0a9" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:36:56 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-a149e9ff-0baa-4d27-90c4-2ad669bce0a9" acquired by "delete_volume" :: waited 0.062s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:36:56 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d729c1-5ffd-4560-8e4b-d0febf129b3d]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:36:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:57 devstack quobyte-client[84221]: System call of process 93355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:36:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9" returned: 0 in 1.183s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:36:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-a149e9ff-0baa-4d27-90c4-2ad669bce0a9" returned: 0 in 0.286s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:36:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-a149e9ff-0baa-4d27-90c4-2ad669bce0a9" released by "delete_volume" :: held 1.777s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:36:58 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created reservations ['08a170a6-e0cd-4e62-a0f9-2bea344c2bc1', 'b4db9ebe-493e-4af1-9c75-dce302514f6d', 'e42ad3da-fd1b-4322-94e4-9260470648e3', '3d1c5554-00bf-4c35-8994-013d5a3e8dfd'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:36:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:36:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:36:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:36:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:36:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:36:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-d3a8e959-9ac0-4ef3-a4eb-968af549e5d8-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:37:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 1.102s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:00 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:37:00 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Deleted volume successfully.
Sep 27 11:37:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-d3a8e959-9ac0-4ef3-a4eb-968af549e5d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.697s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:37:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:37:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-quobyte-2336127b-dc59-4815-bb8d-d05cf559e219" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:37:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-2336127b-dc59-4815-bb8d-d05cf559e219" acquired by "delete_snapshot" :: waited 0.056s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:37:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-quobyte-d3a8e959-9ac0-4ef3-a4eb-968af549e5d8" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:37:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-cac61a49-446d-49e8-88da-b36c7c962912 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-a149e9ff-0baa-4d27-90c4-2ad669bce0a9-delete_volume" released by "delete_volume" :: held 5.172s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:37:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-d3a8e959-9ac0-4ef3-a4eb-968af549e5d8" acquired by "_delete_snapshot" :: waited 0.084s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:37:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Deleting offline snapshot d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 of volume 2336127b-dc59-4815-bb8d-d05cf559e219 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:37:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] snapshot_file for this snap is: volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:37:01 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[3252c0b6-8da5-4dba-94b1-16bea4f9a84e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:37:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:02 devstack quobyte-client[84221]: System call of process 93361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8" returned: 0 in 0.911s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2336127b-dc59-4815-bb8d-d05cf559e219(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:37:02 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9931fd-aef2-4320-afa9-7d46de526f4b]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:37:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219" returned: 0 in 1.124s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:04 devstack quobyte-client[84221]: System call of process 93368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8" returned: 0 in 0.855s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219.d3a8e959-9ac0-4ef3-a4eb-968af549e5d8" returned: 0 in 0.366s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-d3a8e959-9ac0-4ef3-a4eb-968af549e5d8" released by "_delete_snapshot" :: held 4.498s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:37:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-2336127b-dc59-4815-bb8d-d05cf559e219" released by "delete_snapshot" :: held 4.637s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:37:06 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created reservations ['e6900701-9e14-48b2-a413-f9aec0d6eaf0', '1d38ccec-1418-4803-ad02-0cc20c3e9c78', 'f6bcd93c-1769-4f77-bfdf-2d3353e6c68b', '2376707e-1738-43d5-a115-91b11a9d0cfc'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:37:06 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Delete snapshot completed successfully.
Sep 27 11:37:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce8c8919-7a21-4633-ad52-01c610b17188 tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-d3a8e959-9ac0-4ef3-a4eb-968af549e5d8-delete_snapshot" released by "delete_snapshot" :: held 5.752s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:37:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-2336127b-dc59-4815-bb8d-d05cf559e219-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:37:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-2336127b-dc59-4815-bb8d-d05cf559e219-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:37:07 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:37:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "cinder-quobyte-2336127b-dc59-4815-bb8d-d05cf559e219" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:37:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-2336127b-dc59-4815-bb8d-d05cf559e219" acquired by "delete_volume" :: waited 0.029s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:37:07 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a9239e-6013-4f1c-a824-9c2381435d06]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:37:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:08 devstack quobyte-client[84221]: System call of process 93379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219" returned: 0 in 1.011s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2336127b-dc59-4815-bb8d-d05cf559e219" returned: 0 in 0.286s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-quobyte-2336127b-dc59-4815-bb8d-d05cf559e219" released by "delete_volume" :: held 1.724s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Created reservations ['3e175a8f-2c58-46dc-9d8e-fd5c8c5c108d', '5da0c7a3-e9d7-475f-923b-8f7e6910608c', 'db9fe520-c7f9-4399-b77b-ee21732ea8f4', 'e097b1ac-a222-4176-bee7-a407f94238f2'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.109s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:37:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Deleted volume successfully.
Sep 27 11:37:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ed1d7866-c6fd-43cf-98c3-0b9dde0fa0ef tempest-CreateVolumesFromSnapshotTest-1087405305 None] Lock "cinder-2336127b-dc59-4815-bb8d-d05cf559e219-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:37:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:37:17 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:37:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Flow 'volume_create_manager' (176cbd2e-2132-44a5-a384-e2a5f8321287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:37:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb175e0-d362-45c0-bcf1-188937d9d6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb175e0-d362-45c0-bcf1-188937d9d6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-603345435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d85377-d665-4feb-bca6-954155eea577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b886550ee3243e9a8668b73c1baf2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:37:18Z,use_quota=True,user_id='39440dbd612e400f89ad315161893fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faacb6ad-3f15-49f9-a0b9-6b9b57b52396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faacb6ad-3f15-49f9-a0b9-6b9b57b52396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e31a0e-9a9b-4ee9-bc92-e35d8730c63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.image.glance [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Creating Keystone auth plugin from conf {{(pid=84197) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e31a0e-9a9b-4ee9-bc92-e35d8730c63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4d85377-d665-4feb-bca6-954155eea577', 'volume_name': 'volume-b4d85377-d665-4feb-bca6-954155eea577', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d0a5ab0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd529b2-1438-4921-a7cc-0a19fcba18eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd529b2-1438-4921-a7cc-0a19fcba18eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd8c87b-2b46-4589-9347-afed369f7c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:37:18 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Volume b4d85377-d665-4feb-bca6-954155eea577: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4d85377-d665-4feb-bca6-954155eea577', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d0a5ab0>}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Cloning b4d85377-d665-4feb-bca6-954155eea577 from image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3  at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]). {{(pid=84197) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 27 11:37:18 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Image download 20.69 MB at 20.69 MB/s
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3bc05d-6312-40b2-a6ca-b752c9df77e5]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:37:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:19 devstack sudo[93386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD
Sep 27 11:37:19 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:37:21 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root
Sep 27 11:37:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD" returned: 0 in 2.185s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:21 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Temporary image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 is fetched for user 39440dbd612e400f89ad315161893fea. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 27 11:37:21 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c4b1a9-18c5-4f13-9fe4-2ad36e3848d0]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:37:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:21 devstack sudo[93395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD
Sep 27 11:37:21 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:37:23 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD" returned: 0 in 2.103s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-603345435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d85377-d665-4feb-bca6-954155eea577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b886550ee3243e9a8668b73c1baf2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:37:18Z,use_quota=True,user_id='39440dbd612e400f89ad315161893fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Creating volume b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:37:23 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:37:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:23 devstack quobyte-client[84221]: System call of process 93403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:23 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=81, name=volume-b4d85377-d665-4feb-bca6-954155eea577, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 1073741824" returned: 0 in 0.316s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 0 in 0.107s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] <== create_volume: return (522ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=49,cinder:UPDATE=68,cinder:DELETE=5,cinder:INSERT=19 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=63,cinder:DELETE=7,cinder:SELECT=35,cinder:INSERT=10 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Attempting download of 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}])) to volume b4d85377-d665-4feb-bca6-954155eea577. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3677c1-8814-430b-bb36-191c29ebf636]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:37:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_9ph29d0p {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_9ph29d0p" returned: 0 in 0.385s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_9ph29d0p {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_9ph29d0p" returned: 1 in 0.425s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_9ph29d0p' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:37:25 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d424f45-df8c-4c27-b8e0-1841d68b9438]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:37:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:25 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 was qcow2, converting to raw {{(pid=84197) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 27 11:37:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:26 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=81, name=volume-b4d85377-d665-4feb-bca6-954155eea577, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:37:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 0 in 1.162s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:27 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3_feh5b6xmdevstack@QuobyteHD, size 112.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:37:27 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Converted 112.00 MB image at 93.72 MB/s
Sep 27 11:37:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:27 devstack quobyte-client[84221]: System call of process 93425 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 1G" returned: 0 in 0.167s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0589f02a-995f-4ae9-8e0f-d2ee13513819]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:37:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:27 devstack quobyte-client[84221]: System call of process 93428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 0 in 0.450s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:28 devstack quobyte-client[84221]: System call of process 93430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:28 devstack quobyte-client[84221]: System call of process 93430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 1 in 0.455s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Downloaded image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}])) to volume b4d85377-d665-4feb-bca6-954155eea577 successfully. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Temporary image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 for user 39440dbd612e400f89ad315161893fea is deleted. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Marking volume b4d85377-d665-4feb-bca6-954155eea577 as bootable. {{(pid=84197) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Copying metadata from image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 to b4d85377-d665-4feb-bca6-954155eea577. {{(pid=84197) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Creating volume glance metadata for volume b4d85377-d665-4feb-bca6-954155eea577 backed by image 1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84197) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd8c87b-2b46-4589-9347-afed369f7c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d85377-d665-4feb-bca6-954155eea577', 'volume_size': 1, 'image_id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45bbdadd8dc74e55bf17740406868eb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3', 'created_at': datetime.datetime(2025, 9, 27, 9, 7, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 7, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2aaf34-1bbd-4c6b-904d-c1c24c27e4c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d0a5ab0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f3eb58-3dc6-4a1c-930d-75ef54ebbabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:37:28 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Volume volume-b4d85377-d665-4feb-bca6-954155eea577 (b4d85377-d665-4feb-bca6-954155eea577): created successfully
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f3eb58-3dc6-4a1c-930d-75ef54ebbabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:37:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Flow 'volume_create_manager' (176cbd2e-2132-44a5-a384-e2a5f8321287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:37:28 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0f10e86e-3c44-4059-94fe-f7f5200c3bab tempest-TestShelveInstance-1436919172 None] Created volume successfully.
Sep 27 11:37:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:37:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:37:38 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c111fe3-53d7-44a9-9ccd-e6bc4154d4e6]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:37:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:37:39 devstack quobyte-client[84221]: System call of process 93442 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:37:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:37:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:37:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:37:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:37:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 0 in 1.346s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:37:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.848s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:40 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:37:40 devstack quobyte-client[84221]: System call of process 93447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:37:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 1 in 0.507s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:37:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:37:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.962s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:37:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-b4d85377-d665-4feb-bca6-954155eea577', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15e79cf1-d7a0-4b77-81e9-0e56fabcd292', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:37:40 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:37:41 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-2682f3fb-4a37-4a66-b006-446de2d71229 req-78fb1c7e-7c5e-4cab-a8e2-54fb2950d590 tempest-TestShelveInstance-1436919172 None] attachment_update completed successfully.
Sep 27 11:37:51 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:37:51 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=21,cinder:INSERT=12,cinder:UPDATE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:38:06 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Flow 'volume_create_manager' (1c6f8807-89f8-430a-acc4-3c8559b5678e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d4c2e1-7094-47ea-ae16-829774bcb802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d4c2e1-7094-47ea-ae16-829774bcb802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-727794890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec29e9f-9147-4829-b089-d130a4f5e9d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31175a344d846e384f626a1554018ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:38:07Z,use_quota=True,user_id='53fbac6938d1408d9daac8d788438cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8585332a-4ed4-453a-b0e8-b35191715854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8585332a-4ed4-453a-b0e8-b35191715854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86adf3e5-8c19-4f8c-b678-3b569559c836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86adf3e5-8c19-4f8c-b678-3b569559c836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec29e9f-9147-4829-b089-d130a4f5e9d7', 'volume_name': 'volume-aec29e9f-9147-4829-b089-d130a4f5e9d7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b6c4b8-c769-49f3-b55b-d79cb1e75af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b6c4b8-c769-49f3-b55b-d79cb1e75af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2daef9bd-779d-47b3-a672-8d9595037727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:38:06 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Volume aec29e9f-9147-4829-b089-d130a4f5e9d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec29e9f-9147-4829-b089-d130a4f5e9d7', 'volume_size': 1}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-727794890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec29e9f-9147-4829-b089-d130a4f5e9d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31175a344d846e384f626a1554018ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:38:07Z,use_quota=True,user_id='53fbac6938d1408d9daac8d788438cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Creating volume aec29e9f-9147-4829-b089-d130a4f5e9d7 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:38:06 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:38:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:38:07 devstack quobyte-client[84221]: System call of process 94005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:38:07 devstack quobyte-client[84221]: System call of process 94005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:38:07 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=82, name=volume-aec29e9f-9147-4829-b089-d130a4f5e9d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:38:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7 1073741824" returned: 0 in 0.449s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:38:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:38:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7" returned: 0 in 0.134s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:38:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] <== create_volume: return (657ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:38:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:38:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2daef9bd-779d-47b3-a672-8d9595037727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec29e9f-9147-4829-b089-d130a4f5e9d7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:38:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48b2586-5fdc-4b6c-8385-dcb0cb460d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:38:07 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Volume volume-aec29e9f-9147-4829-b089-d130a4f5e9d7 (aec29e9f-9147-4829-b089-d130a4f5e9d7): created successfully
Sep 27 11:38:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48b2586-5fdc-4b6c-8385-dcb0cb460d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:38:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Flow 'volume_create_manager' (1c6f8807-89f8-430a-acc4-3c8559b5678e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:38:07 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-20152e30-ba6b-42a1-a45d-8ee1fc89a95d tempest-AttachVolumeTestJSON-1449472356 None] Created volume successfully.
Sep 27 11:38:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-62507548-42c4-489b-bb36-a01a1d26a072 req-a9f91c6b-bc9f-4f51-aa4a-d22b50cbe695 tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:38:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-62507548-42c4-489b-bb36-a01a1d26a072 req-a9f91c6b-bc9f-4f51-aa4a-d22b50cbe695 tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:38:13 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9596ffd-6ba2-4695-89b2-b0897580f2d1]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:38:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-62507548-42c4-489b-bb36-a01a1d26a072 req-a9f91c6b-bc9f-4f51-aa4a-d22b50cbe695 tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:38:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-62507548-42c4-489b-bb36-a01a1d26a072 req-a9f91c6b-bc9f-4f51-aa4a-d22b50cbe695 tempest-AttachVolumeTestJSON-1449472356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7" returned: 0 in 0.608s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:38:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-62507548-42c4-489b-bb36-a01a1d26a072 req-a9f91c6b-bc9f-4f51-aa4a-d22b50cbe695 tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.674s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:38:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-62507548-42c4-489b-bb36-a01a1d26a072 req-a9f91c6b-bc9f-4f51-aa4a-d22b50cbe695 tempest-AttachVolumeTestJSON-1449472356 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-aec29e9f-9147-4829-b089-d130a4f5e9d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe82c219-3793-4222-838f-6397835167b2', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:38:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-62507548-42c4-489b-bb36-a01a1d26a072 req-a9f91c6b-bc9f-4f51-aa4a-d22b50cbe695 tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:38:14 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-62507548-42c4-489b-bb36-a01a1d26a072 req-a9f91c6b-bc9f-4f51-aa4a-d22b50cbe695 tempest-AttachVolumeTestJSON-1449472356 None] attachment_update completed successfully.
Sep 27 11:38:24 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:38:24 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:38:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:38:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:38:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:38:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:38:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:38:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:38:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:38:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.248s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:38:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:39:16 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-e141f40c-8df0-413e-b447-f9f9f03bcc81 req-5d371609-a162-4dcc-9e4b-7f8b4b0bbb3f tempest-TestShelveInstance-1436919172 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:39:16 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-e141f40c-8df0-413e-b447-f9f9f03bcc81 req-5d371609-a162-4dcc-9e4b-7f8b4b0bbb3f tempest-TestShelveInstance-1436919172 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:39:16 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-e141f40c-8df0-413e-b447-f9f9f03bcc81 req-5d371609-a162-4dcc-9e4b-7f8b4b0bbb3f tempest-TestShelveInstance-1436919172 None] Terminate volume connection completed successfully.
Sep 27 11:39:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-e141f40c-8df0-413e-b447-f9f9f03bcc81 req-5d371609-a162-4dcc-9e4b-7f8b4b0bbb3f tempest-TestShelveInstance-1436919172 None] Deleting attachment 15e79cf1-d7a0-4b77-81e9-0e56fabcd292. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:39:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:39:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:39:23 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[784f8b97-2d29-449e-a6b8-f0a91d4e4cd7]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:39:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:39:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 0 in 0.363s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:39:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:39:24 devstack quobyte-client[84221]: System call of process 94319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:39:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 1 in 0.379s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:39:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:39:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.909s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:39:24 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-b4d85377-d665-4feb-bca6-954155eea577', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fb39ce7-ef49-4b35-adf4-0968c9972373', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:39:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:39:24 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-475d1d38-1563-4200-ad66-63d64458fe97 req-d0c116cd-6117-4161-9596-3e860372ea5c tempest-TestShelveInstance-1436919172 None] attachment_update completed successfully.
Sep 27 11:39:34 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:39:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:39:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:39:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:39:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:39:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:39:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.130s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:39:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:39:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.550s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:39:40 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:39:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:40:13 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-2d2cb710-dd2b-47bc-bb69-c5cfff234af0 req-8d20fe7e-b562-454d-a751-f449aafe0ab7 tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:40:13 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-2d2cb710-dd2b-47bc-bb69-c5cfff234af0 req-8d20fe7e-b562-454d-a751-f449aafe0ab7 tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:40:13 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-2d2cb710-dd2b-47bc-bb69-c5cfff234af0 req-8d20fe7e-b562-454d-a751-f449aafe0ab7 tempest-AttachVolumeTestJSON-1449472356 None] Terminate volume connection completed successfully.
Sep 27 11:40:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-2d2cb710-dd2b-47bc-bb69-c5cfff234af0 req-8d20fe7e-b562-454d-a751-f449aafe0ab7 tempest-AttachVolumeTestJSON-1449472356 None] Deleting attachment fe82c219-3793-4222-838f-6397835167b2. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:40:23 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:40:23 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:40:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:40:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:40:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:40:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:40:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:40:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:40:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:40:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.272s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:40:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:41:06 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-dface158-608e-4155-a002-912d3e67c8be req-47a1bf57-d671-4abf-b066-be5b16f76cb1 tempest-TestShelveInstance-1436919172 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:06 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-dface158-608e-4155-a002-912d3e67c8be req-47a1bf57-d671-4abf-b066-be5b16f76cb1 tempest-TestShelveInstance-1436919172 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:06 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-dface158-608e-4155-a002-912d3e67c8be req-47a1bf57-d671-4abf-b066-be5b16f76cb1 tempest-TestShelveInstance-1436919172 None] Terminate volume connection completed successfully.
Sep 27 11:41:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-dface158-608e-4155-a002-912d3e67c8be req-47a1bf57-d671-4abf-b066-be5b16f76cb1 tempest-TestShelveInstance-1436919172 None] Deleting attachment 9fb39ce7-ef49-4b35-adf4-0968c9972373. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:41:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Acquiring lock "cinder-b4d85377-d665-4feb-bca6-954155eea577-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Lock "cinder-b4d85377-d665-4feb-bca6-954155eea577-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:07 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Acquiring lock "cinder-quobyte-b4d85377-d665-4feb-bca6-954155eea577" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Lock "cinder-quobyte-b4d85377-d665-4feb-bca6-954155eea577" acquired by "delete_volume" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:07 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b016b8b5-0461-4315-bef1-6428b6d2d791]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:41:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:08 devstack quobyte-client[84221]: System call of process 94786 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 0 in 0.503s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 1 in 0.452s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:41:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b4d85377-d665-4feb-bca6-954155eea577" returned: 0 in 0.106s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Lock "cinder-quobyte-b4d85377-d665-4feb-bca6-954155eea577" released by "delete_volume" :: held 1.414s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG cinder.quota [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Created reservations ['b712251a-2969-4b65-af25-5e0fb585adc8', '34113028-0042-48fa-aaff-1537b8f3af34', 'f18dc7fa-0949-4518-9031-52bb477682e9', '77b2189a-701e-48be-9373-92ca2dcc3da5'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.098s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG cinder.manager [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:41:09 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Deleted volume successfully.
Sep 27 11:41:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-dface158-608e-4155-a002-912d3e67c8be req-de762466-3a88-4021-a461-afc1d8a87d46 tempest-TestShelveInstance-1436919172 None] Lock "cinder-b4d85377-d665-4feb-bca6-954155eea577-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:19 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:41:19 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:41:28 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (ff6656e0-a56a-4bca-aa16-075ca26c785f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe582f70-5b94-402d-8f92-05fe726e17a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe582f70-5b94-402d-8f92-05fe726e17a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1101063316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776d613a-28b2-47c9-8509-18bd51ce97f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:28Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c962e4-a458-4eb6-af0d-c87fd0ef5810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c962e4-a458-4eb6-af0d-c87fd0ef5810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6b70bd-e473-49be-983c-da7181db4326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6b70bd-e473-49be-983c-da7181db4326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776d613a-28b2-47c9-8509-18bd51ce97f4', 'volume_name': 'volume-776d613a-28b2-47c9-8509-18bd51ce97f4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07998ad-0082-40c8-9f99-9180af25e6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07998ad-0082-40c8-9f99-9180af25e6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3e6967-4db2-4ca3-aa51-f2c2ee250ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:28 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Volume 776d613a-28b2-47c9-8509-18bd51ce97f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776d613a-28b2-47c9-8509-18bd51ce97f4', 'volume_size': 1}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1101063316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776d613a-28b2-47c9-8509-18bd51ce97f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:28Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Creating volume 776d613a-28b2-47c9-8509-18bd51ce97f4 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:41:28 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:41:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-776d613a-28b2-47c9-8509-18bd51ce97f4 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:29 devstack quobyte-client[84221]: System call of process 94810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:29 devstack quobyte-client[84221]: System call of process 94810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:29 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=83, name=volume-776d613a-28b2-47c9-8509-18bd51ce97f4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:41:29 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (4a8054ab-a938-44f7-bae6-1e994b48e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd304dd9-c099-4f4a-ac2d-012d0885d831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd304dd9-c099-4f4a-ac2d-012d0885d831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545460721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8429a087-0036-41ec-a7d8-dd557469df20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:29Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a462ea35-5dbe-457d-93b6-48c838022a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a462ea35-5dbe-457d-93b6-48c838022a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361a32ff-09b3-4f1b-8b25-e9c38c0e77c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361a32ff-09b3-4f1b-8b25-e9c38c0e77c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8429a087-0036-41ec-a7d8-dd557469df20', 'volume_name': 'volume-8429a087-0036-41ec-a7d8-dd557469df20', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff89739-051c-41d5-91d3-8dbd6c675337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff89739-051c-41d5-91d3-8dbd6c675337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98501d4b-c301-4e92-a04f-feaeb569700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:29 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Volume 8429a087-0036-41ec-a7d8-dd557469df20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8429a087-0036-41ec-a7d8-dd557469df20', 'volume_size': 1}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-776d613a-28b2-47c9-8509-18bd51ce97f4 1073741824" returned: 0 in 0.950s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-776d613a-28b2-47c9-8509-18bd51ce97f4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (5df6e04d-5079-4a79-b246-4ea8d764c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee310cf-3cbe-434f-87e7-d9a4425ac021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee310cf-3cbe-434f-87e7-d9a4425ac021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631761274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66732985-f16a-453a-a711-40dcb5b7ecd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:30Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1ce389-7621-4002-8063-afe3ef78363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1ce389-7621-4002-8063-afe3ef78363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9b9780-e657-496c-9902-80ceed2722b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9b9780-e657-496c-9902-80ceed2722b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66732985-f16a-453a-a711-40dcb5b7ecd4', 'volume_name': 'volume-66732985-f16a-453a-a711-40dcb5b7ecd4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ad5c5d-8a05-4285-bb91-aaf024fd53ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ad5c5d-8a05-4285-bb91-aaf024fd53ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4159aa49-2da4-43ec-9810-0ba5e15d39e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:30 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Volume 66732985-f16a-453a-a711-40dcb5b7ecd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66732985-f16a-453a-a711-40dcb5b7ecd4', 'volume_size': 1}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-776d613a-28b2-47c9-8509-18bd51ce97f4" returned: 0 in 0.786s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] <== create_volume: return (1772ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545460721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8429a087-0036-41ec-a7d8-dd557469df20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:29Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Creating volume 8429a087-0036-41ec-a7d8-dd557469df20 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:41:30 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:41:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8429a087-0036-41ec-a7d8-dd557469df20 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:30 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=84, name=volume-8429a087-0036-41ec-a7d8-dd557469df20, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:41:31 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (e93aff5c-5302-46be-a9df-9496514c95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82cf5a0-2401-4187-a6da-a2855ebb3a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3e6967-4db2-4ca3-aa51-f2c2ee250ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776d613a-28b2-47c9-8509-18bd51ce97f4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41b30be-7a2b-449d-9b75-da9f2a84985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82cf5a0-2401-4187-a6da-a2855ebb3a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1766240609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a39ec6-e534-4eee-8d17-c32b4c6b3145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:30Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2eb5525-c767-478e-9fdd-fa1a63003caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2eb5525-c767-478e-9fdd-fa1a63003caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420680c2-5151-4c85-a1c8-5b90039e90be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420680c2-5151-4c85-a1c8-5b90039e90be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a39ec6-e534-4eee-8d17-c32b4c6b3145', 'volume_name': 'volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa38f06-283c-4d9c-af1d-efeba1786ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa38f06-283c-4d9c-af1d-efeba1786ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3990d01a-7bf2-4e79-9711-7ff1de41a80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:31 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Volume 86a39ec6-e534-4eee-8d17-c32b4c6b3145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145', 'volume_size': 1}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8429a087-0036-41ec-a7d8-dd557469df20 1073741824" returned: 0 in 0.834s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8429a087-0036-41ec-a7d8-dd557469df20 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:31 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Volume volume-776d613a-28b2-47c9-8509-18bd51ce97f4 (776d613a-28b2-47c9-8509-18bd51ce97f4): created successfully
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41b30be-7a2b-449d-9b75-da9f2a84985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (ff6656e0-a56a-4bca-aa16-075ca26c785f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8429a087-0036-41ec-a7d8-dd557469df20" returned: 0 in 0.351s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] <== create_volume: return (1218ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.286s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631761274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66732985-f16a-453a-a711-40dcb5b7ecd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:30Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Creating volume 66732985-f16a-453a-a711-40dcb5b7ecd4 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:41:31 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:41:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-66732985-f16a-453a-a711-40dcb5b7ecd4 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:32 devstack quobyte-client[84221]: System call of process 94826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:32 devstack quobyte-client[84221]: System call of process 94826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:32 devstack quobyte-client[84221]: System call of process 94826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:32 devstack quobyte-client[84221]: System call of process 94826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:32 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=85, name=volume-66732985-f16a-453a-a711-40dcb5b7ecd4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:41:32 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (ca2ba785-596e-4597-97cc-bc4adee40ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34657c02-4dfd-44ed-99d1-3cf3f83c6ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34657c02-4dfd-44ed-99d1-3cf3f83c6ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-256921169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464c3f6c-2e30-46e0-acf7-48e4327e74c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:31Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65af25d-7a9f-4198-8d4f-9d13cd374293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65af25d-7a9f-4198-8d4f-9d13cd374293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdf561a-fcac-441f-b9bd-01d2e7bf7def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdf561a-fcac-441f-b9bd-01d2e7bf7def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464c3f6c-2e30-46e0-acf7-48e4327e74c8', 'volume_name': 'volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f53c80b-9a44-4203-bc96-37dc4670579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f53c80b-9a44-4203-bc96-37dc4670579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2a6ff8-e12d-4461-b3c7-cb4bf92f96a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:32 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Volume 464c3f6c-2e30-46e0-acf7-48e4327e74c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8', 'volume_size': 1}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:32 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7cd83fde-3314-456b-a2cb-da2676a192a9 tempest-CreateVolumesFromImageTest-2036162531 None] Created volume successfully.
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98501d4b-c301-4e92-a04f-feaeb569700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8429a087-0036-41ec-a7d8-dd557469df20', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b49f65-d995-4dda-829c-c66ad14cf5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-66732985-f16a-453a-a711-40dcb5b7ecd4 1073741824" returned: 0 in 0.745s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-66732985-f16a-453a-a711-40dcb5b7ecd4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:32 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Volume volume-8429a087-0036-41ec-a7d8-dd557469df20 (8429a087-0036-41ec-a7d8-dd557469df20): created successfully
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b49f65-d995-4dda-829c-c66ad14cf5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (4a8054ab-a938-44f7-bae6-1e994b48e65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-66732985-f16a-453a-a711-40dcb5b7ecd4" returned: 0 in 0.382s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] <== create_volume: return (1154ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1766240609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a39ec6-e534-4eee-8d17-c32b4c6b3145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:30Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Creating volume 86a39ec6-e534-4eee-8d17-c32b4c6b3145 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:41:33 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:33 devstack quobyte-client[84221]: System call of process 94832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:33 devstack quobyte-client[84221]: System call of process 94832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:33 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=86, name=volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4159aa49-2da4-43ec-9810-0ba5e15d39e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66732985-f16a-453a-a711-40dcb5b7ecd4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e863dd9c-3de3-495f-b2c4-562afc1e89fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-da25c09a-1001-42db-9d4d-5918ffb18a64 tempest-CreateVolumesFromImageTest-2036162531 None] Created volume successfully.
Sep 27 11:41:33 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Volume volume-66732985-f16a-453a-a711-40dcb5b7ecd4 (66732985-f16a-453a-a711-40dcb5b7ecd4): created successfully
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e863dd9c-3de3-495f-b2c4-562afc1e89fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (5df6e04d-5079-4a79-b246-4ea8d764c516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145 1073741824" returned: 0 in 0.574s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c04de52c-965a-421c-8917-4e8be0b5202a tempest-CreateVolumesFromImageTest-2036162531 None] Created volume successfully.
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145" returned: 0 in 0.248s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] <== create_volume: return (859ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-256921169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464c3f6c-2e30-46e0-acf7-48e4327e74c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7f5cc4a5d458d8ef524edd9f5f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:31Z,use_quota=True,user_id='51d3570241be48b197eb153c2a097a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Creating volume 464c3f6c-2e30-46e0-acf7-48e4327e74c8 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:41:33 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:34 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=87, name=volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3990d01a-7bf2-4e79-9711-7ff1de41a80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1208e8-6fec-4b98-9251-1048d8255787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8 1073741824" returned: 0 in 0.471s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:34 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Volume volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145 (86a39ec6-e534-4eee-8d17-c32b4c6b3145): created successfully
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1208e8-6fec-4b98-9251-1048d8255787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (e93aff5c-5302-46be-a9df-9496514c95e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:34 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4665bc11-0381-4969-89aa-36c4e423c5b7 tempest-CreateVolumesFromImageTest-2036162531 None] Created volume successfully.
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8" returned: 0 in 0.509s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] <== create_volume: return (1010ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:41:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2a6ff8-e12d-4461-b3c7-cb4bf92f96a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176815c3-43a7-4062-b039-96ec0dc6aff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:35 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Volume volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8 (464c3f6c-2e30-46e0-acf7-48e4327e74c8): created successfully
Sep 27 11:41:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176815c3-43a7-4062-b039-96ec0dc6aff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Flow 'volume_create_manager' (ca2ba785-596e-4597-97cc-bc4adee40ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:35 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-26953680-b4e8-41a5-bc8e-1e03823f8ada tempest-CreateVolumesFromImageTest-2036162531 None] Created volume successfully.
Sep 27 11:41:36 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-464c3f6c-2e30-46e0-acf7-48e4327e74c8-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:36 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-464c3f6c-2e30-46e0-acf7-48e4327e74c8-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:36 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:36 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-quobyte-464c3f6c-2e30-46e0-acf7-48e4327e74c8" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:36 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-464c3f6c-2e30-46e0-acf7-48e4327e74c8" acquired by "delete_volume" :: waited 0.021s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:36 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d3e0f-89df-4947-92d7-5089973e5af0]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:41:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:36 devstack quobyte-client[84221]: System call of process 94841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8" returned: 0 in 0.463s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-464c3f6c-2e30-46e0-acf7-48e4327e74c8" returned: 0 in 0.102s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-464c3f6c-2e30-46e0-acf7-48e4327e74c8" released by "delete_volume" :: held 0.747s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Created reservations ['018f1066-ef27-4fcc-bd33-448a96b5a4c8', '2a1a4fcc-3371-45e5-81ee-8199113ad5bc', '32b1ed21-e659-4e30-a139-07934cd179b8', '6829ca35-666d-4709-b9ee-c85cbc571a1c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:37 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:41:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Deleted volume successfully.
Sep 27 11:41:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e05da0a4-82b1-47d6-8f96-2b4132660b2b tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-464c3f6c-2e30-46e0-acf7-48e4327e74c8-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-86a39ec6-e534-4eee-8d17-c32b4c6b3145-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-86a39ec6-e534-4eee-8d17-c32b4c6b3145-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:38 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-quobyte-86a39ec6-e534-4eee-8d17-c32b4c6b3145" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-86a39ec6-e534-4eee-8d17-c32b4c6b3145" acquired by "delete_volume" :: waited 0.023s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:38 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d8d2d3-b7eb-48a9-8084-a7f21df4bf4e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:41:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:39 devstack quobyte-client[84221]: System call of process 94846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145" returned: 0 in 0.570s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.202s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-86a39ec6-e534-4eee-8d17-c32b4c6b3145" returned: 0 in 0.193s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-86a39ec6-e534-4eee-8d17-c32b4c6b3145" released by "delete_volume" :: held 0.938s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:39 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Created reservations ['528986b8-ef8e-4d09-a8d6-e123ddefbd4d', 'f5933ea9-2240-42fa-ae9d-5ffa0b255dc8', '8bc0dd7b-8d35-4684-a0c9-934d375ad5b2', 'c6e050d4-44d5-4d5f-b409-827d478bd74a'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.101s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:41:40 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Deleted volume successfully.
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-46c68aad-0a65-433c-a542-16708a3981c8 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-86a39ec6-e534-4eee-8d17-c32b4c6b3145-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-66732985-f16a-453a-a711-40dcb5b7ecd4-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-66732985-f16a-453a-a711-40dcb5b7ecd4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-quobyte-66732985-f16a-453a-a711-40dcb5b7ecd4" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-66732985-f16a-453a-a711-40dcb5b7ecd4" acquired by "delete_volume" :: waited 0.014s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:41 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cccf41d-a694-43fe-83ec-85c1ba09077f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:41:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-66732985-f16a-453a-a711-40dcb5b7ecd4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-66732985-f16a-453a-a711-40dcb5b7ecd4" returned: 0 in 0.515s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-66732985-f16a-453a-a711-40dcb5b7ecd4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-66732985-f16a-453a-a711-40dcb5b7ecd4" returned: 0 in 0.108s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:41 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-66732985-f16a-453a-a711-40dcb5b7ecd4" released by "delete_volume" :: held 0.800s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Created reservations ['281bfcc1-c010-472b-ab03-6df8f6df1062', '3bdd4c0c-9fff-45d9-b74c-9cf96129e136', '6807b559-413b-4999-9cb6-0f4dc030805a', 'd33559b6-8bb7-4eb1-9b2d-6fdaf73e1ab6'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.112s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:41:42 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Deleted volume successfully.
Sep 27 11:41:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6d43ba37-617f-4b62-83a6-8d074606dbe3 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-66732985-f16a-453a-a711-40dcb5b7ecd4-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-8429a087-0036-41ec-a7d8-dd557469df20-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-8429a087-0036-41ec-a7d8-dd557469df20-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:43 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-quobyte-8429a087-0036-41ec-a7d8-dd557469df20" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-8429a087-0036-41ec-a7d8-dd557469df20" acquired by "delete_volume" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:43 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad4686e-ca7a-4157-9f86-2dea6296bb86]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:41:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8429a087-0036-41ec-a7d8-dd557469df20 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8429a087-0036-41ec-a7d8-dd557469df20" returned: 0 in 0.417s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8429a087-0036-41ec-a7d8-dd557469df20 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8429a087-0036-41ec-a7d8-dd557469df20" returned: 0 in 0.094s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-8429a087-0036-41ec-a7d8-dd557469df20" released by "delete_volume" :: held 0.659s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Created reservations ['c1ed8bfd-ba7a-46f1-8d1e-358199e14312', 'd530a491-ab68-4575-982e-57e2bf515320', '4574f8f3-d49e-4524-9ac1-8a2f4013695a', '957f5f07-2bbc-4af3-95be-4ad3d044223c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.097s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:44 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:41:44 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Deleted volume successfully.
Sep 27 11:41:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5086c9d9-b4b1-4235-9eb4-afc9c99854c7 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-8429a087-0036-41ec-a7d8-dd557469df20-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-776d613a-28b2-47c9-8509-18bd51ce97f4-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-776d613a-28b2-47c9-8509-18bd51ce97f4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "cinder-quobyte-776d613a-28b2-47c9-8509-18bd51ce97f4" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:41:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-776d613a-28b2-47c9-8509-18bd51ce97f4" acquired by "delete_volume" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:41:45 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7c663-5711-475a-af24-29a1c54a309c]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:41:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-776d613a-28b2-47c9-8509-18bd51ce97f4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:46 devstack quobyte-client[84221]: System call of process 94863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-776d613a-28b2-47c9-8509-18bd51ce97f4" returned: 0 in 0.424s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-776d613a-28b2-47c9-8509-18bd51ce97f4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-776d613a-28b2-47c9-8509-18bd51ce97f4" returned: 0 in 0.126s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-quobyte-776d613a-28b2-47c9-8509-18bd51ce97f4" released by "delete_volume" :: held 0.714s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Created reservations ['c6957980-e592-43d7-a123-5f91e7608ccc', 'aa1c7c10-d39d-477d-80cf-bda3764b983f', '0016dd92-5692-4470-8c82-877defd949fa', 'e1d8db56-b3aa-4295-9f87-bd707e79f910'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.090s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:47 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:41:47 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Deleted volume successfully.
Sep 27 11:41:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4e1f5ec9-c780-4080-a002-c21318a509c2 tempest-CreateVolumesFromImageTest-2036162531 None] Lock "cinder-776d613a-28b2-47c9-8509-18bd51ce97f4-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:41:52 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:52 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (4d7577d4-f4a3-4f52-bfdd-db24b1614f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf49a1ca-350a-429d-a93e-04a4b9a67aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf49a1ca-350a-429d-a93e-04a4b9a67aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952250810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f105692-290b-4fc8-b19b-006f2709184a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:53Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2926eb12-b3ab-46b6-889b-c85ed6d52f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2926eb12-b3ab-46b6-889b-c85ed6d52f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7743d7b-fec5-41ea-b8f9-654349a32343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7743d7b-fec5-41ea-b8f9-654349a32343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f105692-290b-4fc8-b19b-006f2709184a', 'volume_name': 'volume-9f105692-290b-4fc8-b19b-006f2709184a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4ce41b-4419-4205-951f-2a5a608bca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4ce41b-4419-4205-951f-2a5a608bca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f54049-7f35-41fd-b1c7-e4cae85c8366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:53 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume 9f105692-290b-4fc8-b19b-006f2709184a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f105692-290b-4fc8-b19b-006f2709184a', 'volume_size': 1}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952250810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f105692-290b-4fc8-b19b-006f2709184a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:53Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Creating volume 9f105692-290b-4fc8-b19b-006f2709184a {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:41:53 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9f105692-290b-4fc8-b19b-006f2709184a 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:53 devstack quobyte-client[84221]: System call of process 94906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:53 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=88, name=volume-9f105692-290b-4fc8-b19b-006f2709184a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:41:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9f105692-290b-4fc8-b19b-006f2709184a 1073741824" returned: 0 in 0.675s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9f105692-290b-4fc8-b19b-006f2709184a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9f105692-290b-4fc8-b19b-006f2709184a" returned: 0 in 0.420s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] <== create_volume: return (1267ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:41:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f54049-7f35-41fd-b1c7-e4cae85c8366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f105692-290b-4fc8-b19b-006f2709184a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39f32df-8291-48d4-a2e8-c3f25fb8e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:55 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume volume-9f105692-290b-4fc8-b19b-006f2709184a (9f105692-290b-4fc8-b19b-006f2709184a): created successfully
Sep 27 11:41:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39f32df-8291-48d4-a2e8-c3f25fb8e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (4d7577d4-f4a3-4f52-bfdd-db24b1614f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-bfd0606b-83a8-4b08-8ed8-423fe7157809 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created volume successfully.
Sep 27 11:41:56 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (000ddbe5-9c69-4b62-bf74-721d75480ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07ddce7-5e8f-436f-9057-87e057288967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07ddce7-5e8f-436f-9057-87e057288967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1389950200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2d961f-791a-4eb8-9e8c-eba1e11e9719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:57Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec40979-7384-46e8-9336-e3abe0add58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec40979-7384-46e8-9336-e3abe0add58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a5ea8f-77f3-4ced-aa16-e03cc063f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a5ea8f-77f3-4ced-aa16-e03cc063f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a2d961f-791a-4eb8-9e8c-eba1e11e9719', 'volume_name': 'volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7757aa5e-b488-4b59-95f1-a7c601d5a2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7757aa5e-b488-4b59-95f1-a7c601d5a2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5767e419-a725-453b-bbd1-a5448520de0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:56 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume 4a2d961f-791a-4eb8-9e8c-eba1e11e9719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719', 'volume_size': 1}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1389950200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a2d961f-791a-4eb8-9e8c-eba1e11e9719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:57Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Creating volume 4a2d961f-791a-4eb8-9e8c-eba1e11e9719 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:41:57 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:41:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:57 devstack quobyte-client[84221]: System call of process 94948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:57 devstack quobyte-client[84221]: System call of process 94948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:57 devstack quobyte-client[84221]: System call of process 94948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:57 devstack quobyte-client[84221]: System call of process 94948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:57 devstack quobyte-client[84221]: System call of process 94948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:57 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=89, name=volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:41:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719 1073741824" returned: 0 in 0.785s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:57 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (81113c07-0b2e-4dcd-b42d-58d780a2bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7adbc86a-bd61-4bc7-bcf4-88cf050d5084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:58 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (e8eb5d36-fe61-4c8b-b353-d9eed04e03f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8f0222-3946-4f48-addb-fa3e9fb78ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719" returned: 0 in 0.802s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] <== create_volume: return (1626ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7adbc86a-bd61-4bc7-bcf4-88cf050d5084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-604206670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2212f701-468a-4604-816b-2a64eaa331d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:57Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8844ed-4247-41ac-b913-41e817ecaecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8844ed-4247-41ac-b913-41e817ecaecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d17606-adee-46c4-a7e2-ba959392bd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d17606-adee-46c4-a7e2-ba959392bd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2212f701-468a-4604-816b-2a64eaa331d4', 'volume_name': 'volume-2212f701-468a-4604-816b-2a64eaa331d4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141bd62a-265f-40e5-ab02-164d6cc3c06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141bd62a-265f-40e5-ab02-164d6cc3c06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f68f694-6c59-4a9b-a325-262c04a0bc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:58 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume 2212f701-468a-4604-816b-2a64eaa331d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2212f701-468a-4604-816b-2a64eaa331d4', 'volume_size': 1}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-604206670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2212f701-468a-4604-816b-2a64eaa331d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:57Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Creating volume 2212f701-468a-4604-816b-2a64eaa331d4 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:41:58 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:41:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2212f701-468a-4604-816b-2a64eaa331d4 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:58 devstack quobyte-client[84221]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:58 devstack quobyte-client[84221]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:58 devstack quobyte-client[84221]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:58 devstack quobyte-client[84221]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:58 devstack quobyte-client[84221]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:58 devstack quobyte-client[84221]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:58 devstack quobyte-client[84221]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:41:59 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=90, name=volume-2212f701-468a-4604-816b-2a64eaa331d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8f0222-3946-4f48-addb-fa3e9fb78ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-266843138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7502f74-c55f-4474-913f-0b68c0aade0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:58Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b860520b-5a78-485c-ae4e-88a0b7275e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b860520b-5a78-485c-ae4e-88a0b7275e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86f9d58-9f22-4274-9efe-bb99d7d97317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86f9d58-9f22-4274-9efe-bb99d7d97317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7502f74-c55f-4474-913f-0b68c0aade0c', 'volume_name': 'volume-e7502f74-c55f-4474-913f-0b68c0aade0c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ad20b9-9dcb-45de-a785-d111b1366e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ad20b9-9dcb-45de-a785-d111b1366e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934420ec-82de-4b61-aab3-882e3054a9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume e7502f74-c55f-4474-913f-0b68c0aade0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7502f74-c55f-4474-913f-0b68c0aade0c', 'volume_size': 1}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5767e419-a725-453b-bbd1-a5448520de0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a870fa2-2aa4-4281-8ad1-79d01c1ebff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (61ed8afe-4a02-4d8e-9e53-8834d8d61f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b478c195-504d-4f74-8319-76074f214724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b478c195-504d-4f74-8319-76074f214724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1816325353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc33543-3cfc-464c-b002-8e5f9f489d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:58Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87885ef9-e149-4375-95dd-028c1a94b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87885ef9-e149-4375-95dd-028c1a94b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea8c988-0d88-4497-9115-21a573155315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea8c988-0d88-4497-9115-21a573155315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc33543-3cfc-464c-b002-8e5f9f489d6e', 'volume_name': 'volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd4a26b-6c42-4502-a63e-baca70604dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd4a26b-6c42-4502-a63e-baca70604dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f9b819-e64b-4331-ab35-bc76709492e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:41:59 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume cfc33543-3cfc-464c-b002-8e5f9f489d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e', 'volume_size': 1}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2212f701-468a-4604-816b-2a64eaa331d4 1073741824" returned: 0 in 0.849s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2212f701-468a-4604-816b-2a64eaa331d4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:41:59 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719 (4a2d961f-791a-4eb8-9e8c-eba1e11e9719): created successfully
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a870fa2-2aa4-4281-8ad1-79d01c1ebff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (000ddbe5-9c69-4b62-bf74-721d75480ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2212f701-468a-4604-816b-2a64eaa331d4" returned: 0 in 0.385s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] <== create_volume: return (1255ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-266843138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7502f74-c55f-4474-913f-0b68c0aade0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:58Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Creating volume e7502f74-c55f-4474-913f-0b68c0aade0c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:41:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:42:00 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e7502f74-c55f-4474-913f-0b68c0aade0c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:42:00 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=91, name=volume-e7502f74-c55f-4474-913f-0b68c0aade0c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (167e3947-87cd-404d-9ec0-febd01bddbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331e00e4-ca39-4959-852c-2824ec1d8886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:00 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-399c29f6-9876-4954-b896-73a8ac549472 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created volume successfully.
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f68f694-6c59-4a9b-a325-262c04a0bc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2212f701-468a-4604-816b-2a64eaa331d4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2912f1-9329-459b-b5b8-f59abc830bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:00 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume volume-2212f701-468a-4604-816b-2a64eaa331d4 (2212f701-468a-4604-816b-2a64eaa331d4): created successfully
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2912f1-9329-459b-b5b8-f59abc830bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (81113c07-0b2e-4dcd-b42d-58d780a2bb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331e00e4-ca39-4959-852c-2824ec1d8886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1716382612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e086f2a-cf98-4e5d-93ac-79e40b43645c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:59Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3743a4ee-d064-4b65-aef2-5131b90e4243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3743a4ee-d064-4b65-aef2-5131b90e4243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6df8e7-5ee3-4981-8737-a481d86d071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6df8e7-5ee3-4981-8737-a481d86d071e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e086f2a-cf98-4e5d-93ac-79e40b43645c', 'volume_name': 'volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c42e17-f08e-4962-a35c-ad9e6ce8fb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c42e17-f08e-4962-a35c-ad9e6ce8fb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ed3b7a-738b-4406-ad45-e882d6a2347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:00 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume 9e086f2a-cf98-4e5d-93ac-79e40b43645c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c', 'volume_size': 1}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e7502f74-c55f-4474-913f-0b68c0aade0c 1073741824" returned: 0 in 0.676s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e7502f74-c55f-4474-913f-0b68c0aade0c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:00 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-567b98db-5f0f-4133-8b5d-081411cfec02 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created volume successfully.
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e7502f74-c55f-4474-913f-0b68c0aade0c" returned: 0 in 0.255s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] <== create_volume: return (988ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:42:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.456s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1816325353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc33543-3cfc-464c-b002-8e5f9f489d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:58Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Creating volume cfc33543-3cfc-464c-b002-8e5f9f489d6e {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:42:01 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:01 devstack quobyte-client[84221]: System call of process 94960 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934420ec-82de-4b61-aab3-882e3054a9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7502f74-c55f-4474-913f-0b68c0aade0c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:01 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=92, name=volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b3a866-0625-45ab-bf92-2a1bde26dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:01 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume volume-e7502f74-c55f-4474-913f-0b68c0aade0c (e7502f74-c55f-4474-913f-0b68c0aade0c): created successfully
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b3a866-0625-45ab-bf92-2a1bde26dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (e8eb5d36-fe61-4c8b-b353-d9eed04e03f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:42:01 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ee1c0500-869f-4937-8b5e-f27ab0b6dc73 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created volume successfully.
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e 1073741824" returned: 0 in 0.614s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e" returned: 0 in 0.177s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] <== create_volume: return (841ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:42:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1716382612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e086f2a-cf98-4e5d-93ac-79e40b43645c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcac3061cb024474a8a523ffc3226d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:41:59Z,use_quota=True,user_id='b2a2b20072ec4aac8b8ebef1a472437a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Creating volume 9e086f2a-cf98-4e5d-93ac-79e40b43645c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:42:02 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:02 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=93, name=volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f9b819-e64b-4331-ab35-bc76709492e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d736a580-9d6d-4465-b061-e5a2beb903e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c 1073741824" returned: 0 in 0.490s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:02 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e (cfc33543-3cfc-464c-b002-8e5f9f489d6e): created successfully
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d736a580-9d6d-4465-b061-e5a2beb903e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (61ed8afe-4a02-4d8e-9e53-8834d8d61f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:42:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c" returned: 0 in 0.465s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] <== create_volume: return (992ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:42:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:03 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a232cf2c-0f95-4840-ae38-7e1690e80df5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created volume successfully.
Sep 27 11:42:03 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ed3b7a-738b-4406-ad45-e882d6a2347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:03 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f082a3d3-9b3f-4cfa-9269-1d218112e2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:03 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c (9e086f2a-cf98-4e5d-93ac-79e40b43645c): created successfully
Sep 27 11:42:03 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f082a3d3-9b3f-4cfa-9269-1d218112e2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:03 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Flow 'volume_create_manager' (167e3947-87cd-404d-9ec0-febd01bddbad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:42:03 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ec2f7e18-2b70-4743-aa73-f2a423a51c29 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created volume successfully.
Sep 27 11:42:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-9e086f2a-cf98-4e5d-93ac-79e40b43645c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-9e086f2a-cf98-4e5d-93ac-79e40b43645c-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:04 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:42:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-quobyte-9e086f2a-cf98-4e5d-93ac-79e40b43645c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-9e086f2a-cf98-4e5d-93ac-79e40b43645c" acquired by "delete_volume" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:04 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3546fa9-8f13-4151-8797-7cad68e8a81d]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:05 devstack quobyte-client[84221]: System call of process 94969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c" returned: 0 in 0.505s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9e086f2a-cf98-4e5d-93ac-79e40b43645c" returned: 0 in 0.122s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-9e086f2a-cf98-4e5d-93ac-79e40b43645c" released by "delete_volume" :: held 0.840s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:05 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created reservations ['4247286d-4476-4b4a-9b44-0a445ba1239e', 'f22ae90a-fe33-40d6-b180-e35fcfb91b22', 'e30c7206-206b-4d2d-b575-c20864aaf6be', '488309b5-7ce5-4385-b427-57069bfc237a'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.113s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:42:06 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Deleted volume successfully.
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-55938caf-8777-4068-9df3-70262ccf9ade tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-9e086f2a-cf98-4e5d-93ac-79e40b43645c-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-cfc33543-3cfc-464c-b002-8e5f9f489d6e-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-cfc33543-3cfc-464c-b002-8e5f9f489d6e-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:07 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:42:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-quobyte-cfc33543-3cfc-464c-b002-8e5f9f489d6e" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-cfc33543-3cfc-464c-b002-8e5f9f489d6e" acquired by "delete_volume" :: waited 0.015s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:07 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[48547825-3467-44e0-91c0-ade9c7741b30]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:07 devstack quobyte-client[84221]: System call of process 94981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:07 devstack quobyte-client[84221]: System call of process 94981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e" returned: 0 in 0.512s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cfc33543-3cfc-464c-b002-8e5f9f489d6e" returned: 0 in 0.110s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-cfc33543-3cfc-464c-b002-8e5f9f489d6e" released by "delete_volume" :: held 0.805s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created reservations ['3b84af6e-156c-4b77-9870-2de335b78ecd', '67ab0993-115c-43d2-bf2d-e46baa5fecc9', 'd6de15b2-c3ac-4c3e-bfcf-5b35b2fe307c', 'd8e8f630-4547-4ec3-a103-0557df87fbbd'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.128s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:08 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:42:08 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Deleted volume successfully.
Sep 27 11:42:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f2af37c5-40f5-4c9b-af07-45cbb282a6d1 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-cfc33543-3cfc-464c-b002-8e5f9f489d6e-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-e7502f74-c55f-4474-913f-0b68c0aade0c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-e7502f74-c55f-4474-913f-0b68c0aade0c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:09 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:42:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-quobyte-e7502f74-c55f-4474-913f-0b68c0aade0c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-e7502f74-c55f-4474-913f-0b68c0aade0c" acquired by "delete_volume" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:09 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[3421e246-9901-4cc8-b74a-4c389b8159b3]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e7502f74-c55f-4474-913f-0b68c0aade0c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:10 devstack quobyte-client[84221]: System call of process 94986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e7502f74-c55f-4474-913f-0b68c0aade0c" returned: 0 in 0.471s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e7502f74-c55f-4474-913f-0b68c0aade0c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e7502f74-c55f-4474-913f-0b68c0aade0c" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-e7502f74-c55f-4474-913f-0b68c0aade0c" released by "delete_volume" :: held 0.770s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:10 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created reservations ['512747ff-dec1-40b7-923c-77c78de538f2', 'e76a315c-a6e5-4e69-aee9-9fd3e93352af', '06c00cbd-fffe-41be-a9c0-07b5cb27e0b1', 'e0689475-d1e2-44a2-ba16-d5c09046f00d'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.106s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:42:11 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Deleted volume successfully.
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a543a234-7461-4233-8ba0-e8da134a2a93 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-e7502f74-c55f-4474-913f-0b68c0aade0c-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-2212f701-468a-4604-816b-2a64eaa331d4-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-2212f701-468a-4604-816b-2a64eaa331d4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:11 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-quobyte-2212f701-468a-4604-816b-2a64eaa331d4" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-2212f701-468a-4604-816b-2a64eaa331d4" acquired by "delete_volume" :: waited 0.024s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:12 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[f659a1fa-a60c-45a3-b3e7-c1d0176a0523]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2212f701-468a-4604-816b-2a64eaa331d4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:12 devstack quobyte-client[84221]: System call of process 94991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2212f701-468a-4604-816b-2a64eaa331d4" returned: 0 in 0.455s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2212f701-468a-4604-816b-2a64eaa331d4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2212f701-468a-4604-816b-2a64eaa331d4" returned: 0 in 0.095s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-2212f701-468a-4604-816b-2a64eaa331d4" released by "delete_volume" :: held 0.736s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:12 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created reservations ['8492062d-0e99-43ae-8f50-29c06b3a51bd', '744823ac-4014-4546-b263-494a3cfebcce', 'efe546d0-7197-4071-b6ec-2404aedd6a60', '259cf582-c353-437e-b0f6-0f83372de368'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:42:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.110s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:13 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:42:13 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Deleted volume successfully.
Sep 27 11:42:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e23c3ed2-bebb-453d-9613-9143643b34e5 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-2212f701-468a-4604-816b-2a64eaa331d4-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-4a2d961f-791a-4eb8-9e8c-eba1e11e9719-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-4a2d961f-791a-4eb8-9e8c-eba1e11e9719-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:42:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-quobyte-4a2d961f-791a-4eb8-9e8c-eba1e11e9719" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-4a2d961f-791a-4eb8-9e8c-eba1e11e9719" acquired by "delete_volume" :: waited 0.039s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:14 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b20afc-78ef-488d-af30-c1a7d039c5ca]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:15 devstack quobyte-client[84221]: System call of process 94996 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719" returned: 0 in 0.595s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-4a2d961f-791a-4eb8-9e8c-eba1e11e9719" returned: 0 in 0.143s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-4a2d961f-791a-4eb8-9e8c-eba1e11e9719" released by "delete_volume" :: held 1.016s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created reservations ['e84b1d7b-0e74-45f8-9a2f-be684629d470', '858828e9-a870-4a82-b6cb-d8a6db4d6946', 'f66fece7-037c-4fca-b1c6-e92985644e3a', 'a31a5565-af0f-4b85-9083-7997ec716888'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.163s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:16 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:42:16 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Deleted volume successfully.
Sep 27 11:42:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-9f105692-290b-4fc8-b19b-006f2709184a-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4a0fa3da-c9f2-4476-bc23-64b09550365a tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-4a2d961f-791a-4eb8-9e8c-eba1e11e9719-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-9f105692-290b-4fc8-b19b-006f2709184a-delete_volume" acquired by "delete_volume" :: waited 0.142s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:42:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "cinder-quobyte-9f105692-290b-4fc8-b19b-006f2709184a" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-9f105692-290b-4fc8-b19b-006f2709184a" acquired by "delete_volume" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:17 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dae16bb-6eb0-409b-82b1-38027f0f019e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9f105692-290b-4fc8-b19b-006f2709184a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:18 devstack quobyte-client[84221]: System call of process 95006 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9f105692-290b-4fc8-b19b-006f2709184a" returned: 0 in 0.796s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9f105692-290b-4fc8-b19b-006f2709184a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9f105692-290b-4fc8-b19b-006f2709184a" returned: 0 in 0.181s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-quobyte-9f105692-290b-4fc8-b19b-006f2709184a" released by "delete_volume" :: held 1.251s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:18 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Created reservations ['cbccbfdf-0d10-4422-b0b5-b5b9e51d9764', '417cf144-553e-4a6f-bd7c-67f963c3ea90', '6c4ed7ee-2432-4a43-af00-bf2fe2b12cef', '47599163-603b-4f26-9d88-ec7b22839f14'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:42:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.210s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:19 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:42:19 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Deleted volume successfully.
Sep 27 11:42:19 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7d4de975-7623-4e74-8a97-959abdfe0e66 tempest-CreateVolumesFromSourceVolumeTest-1146994991 None] Lock "cinder-9f105692-290b-4fc8-b19b-006f2709184a-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:25 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=111,cinder:SELECT=59,cinder:DELETE=15,cinder:INSERT=27 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:42:25 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=75,cinder:UPDATE=111,cinder:DELETE=7,cinder:INSERT=17 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:42:25 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:42:25 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Flow 'volume_create_manager' (02247117-0f15-46ed-844e-e30f4e8d78ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea957e82-adef-4308-9882-dd744ca2ab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea957e82-adef-4308-9882-dd744ca2ab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327a9d64-17af-4bc2-9a53-ffede6d2b4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39483d2da12f4aefbb70147abf271bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:42:26Z,use_quota=True,user_id='1a5b183ddd1044f58ac4c206565103f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b9cfb4-1cd0-4318-8143-9a74b3b3fd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b9cfb4-1cd0-4318-8143-9a74b3b3fd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c1944d-45b2-4a83-b936-4a8a3cf5d135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.image.glance [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Creating Keystone auth plugin from conf {{(pid=84197) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c1944d-45b2-4a83-b936-4a8a3cf5d135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '327a9d64-17af-4bc2-9a53-ffede6d2b4ed', 'volume_name': 'volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed', 'volume_size': 1, 'image_id': '19e39e1c-7f83-4acc-8043-8614d79bae2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19e39e1c-7f83-4acc-8043-8614d79bae2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5113bc2468f8e72fa8acbd5c9e5774f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '39483d2da12f4aefbb70147abf271bca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '988aa2d1b3b84042d26bbd9f3674932edc71e51873020728f4d4e370f651b88d5808b1d9cd80beac2d0e066e6af79c943cf72d3486d1e96110deefb3459aea34', 'id': '19e39e1c-7f83-4acc-8043-8614d79bae2f', 'created_at': datetime.datetime(2025, 9, 27, 9, 42, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 42, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19e39e1c-7f83-4acc-8043-8614d79bae2f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d587bb0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1389a806-6af7-4b59-813f-4095e68c6934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1389a806-6af7-4b59-813f-4095e68c6934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39fa5f1-6360-4f56-b416-8794bf1115db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:26 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Volume 327a9d64-17af-4bc2-9a53-ffede6d2b4ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed', 'volume_size': 1, 'image_id': '19e39e1c-7f83-4acc-8043-8614d79bae2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19e39e1c-7f83-4acc-8043-8614d79bae2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5113bc2468f8e72fa8acbd5c9e5774f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '39483d2da12f4aefbb70147abf271bca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '988aa2d1b3b84042d26bbd9f3674932edc71e51873020728f4d4e370f651b88d5808b1d9cd80beac2d0e066e6af79c943cf72d3486d1e96110deefb3459aea34', 'id': '19e39e1c-7f83-4acc-8043-8614d79bae2f', 'created_at': datetime.datetime(2025, 9, 27, 9, 42, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 42, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19e39e1c-7f83-4acc-8043-8614d79bae2f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d587bb0>}
Sep 27 11:42:26 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Cloning 327a9d64-17af-4bc2-9a53-ffede6d2b4ed from image 19e39e1c-7f83-4acc-8043-8614d79bae2f  at location (None, [{'url': 'file:///opt/stack/data/glance/images/19e39e1c-7f83-4acc-8043-8614d79bae2f', 'metadata': {}}]). {{(pid=84197) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 27 11:42:27 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 27 11:42:27 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Image download 0.00 MB at 0.00 MB/s
Sep 27 11:42:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9486a3d3-9e94-498b-907a-b311817ea904]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:28 devstack sudo[95060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD
Sep 27 11:42:28 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:42:32 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root
Sep 27 11:42:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD" returned: 0 in 4.827s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:32 devstack sudo[95109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD
Sep 27 11:42:32 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:42:34 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root
Sep 27 11:42:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD" returned: 1 in 2.538s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:42:34 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Temporary image 19e39e1c-7f83-4acc-8043-8614d79bae2f is fetched for user 1a5b183ddd1044f58ac4c206565103f0. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 27 11:42:35 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[39359143-ec0a-48c6-b176-61c4eee9c0b7]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:35 devstack sudo[95115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD
Sep 27 11:42:35 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:42:38 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root
Sep 27 11:42:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD" returned: 0 in 2.931s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:39 devstack sudo[95120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD
Sep 27 11:42:39 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 11:42:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:42:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.339s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:42:41 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD" returned: 1 in 3.141s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327a9d64-17af-4bc2-9a53-ffede6d2b4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39483d2da12f4aefbb70147abf271bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:42:26Z,use_quota=True,user_id='1a5b183ddd1044f58ac4c206565103f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Creating volume 327a9d64-17af-4bc2-9a53-ffede6d2b4ed {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:42:41 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:42:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:41 devstack quobyte-client[84221]: System call of process 95127 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:41 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=94, name=volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:42:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed 1073741824" returned: 0 in 0.802s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" returned: 0 in 0.144s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] <== create_volume: return (1065ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:42:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:42 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Attempting download of 19e39e1c-7f83-4acc-8043-8614d79bae2f ((None, [{'url': 'file:///opt/stack/data/glance/images/19e39e1c-7f83-4acc-8043-8614d79bae2f', 'metadata': {}}])) to volume 327a9d64-17af-4bc2-9a53-ffede6d2b4ed. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 27 11:42:43 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0417d7a3-e9b2-42d2-ba46-5d5db222d753]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19e39e1c-7f83-4acc-8043-8614d79bae2f_bge3w6g9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19e39e1c-7f83-4acc-8043-8614d79bae2f_bge3w6g9" returned: 0 in 0.475s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19e39e1c-7f83-4acc-8043-8614d79bae2f_bge3w6g9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19e39e1c-7f83-4acc-8043-8614d79bae2f_bge3w6g9" returned: 1 in 0.604s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19e39e1c-7f83-4acc-8043-8614d79bae2f_bge3w6g9' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:42:44 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b6f0ce-90ea-48c9-85eb-5e801aa27063]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD" returned: 1 in 0.462s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:42:45 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] 19e39e1c-7f83-4acc-8043-8614d79bae2f was raw, converting to raw {{(pid=84197) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 27 11:42:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:45 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=94, name=volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:42:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" returned: 0 in 0.356s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:45 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19e39e1c-7f83-4acc-8043-8614d79bae2f_d65a8_9xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:42:45 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Converted 0.00 MB image at 0.00 MB/s
Sep 27 11:42:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:45 devstack quobyte-client[84221]: System call of process 95144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed 1G" returned: 0 in 0.259s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:46 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aece01-e45f-441c-b3fc-562a08d72970]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" returned: 0 in 0.627s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:47 devstack quobyte-client[84221]: System call of process 95149 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:47 devstack quobyte-client[84221]: System call of process 95149 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:47 devstack quobyte-client[84221]: System call of process 95149 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" returned: 1 in 0.602s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:42:47 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Downloaded image 19e39e1c-7f83-4acc-8043-8614d79bae2f ((None, [{'url': 'file:///opt/stack/data/glance/images/19e39e1c-7f83-4acc-8043-8614d79bae2f', 'metadata': {}}])) to volume 327a9d64-17af-4bc2-9a53-ffede6d2b4ed successfully. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 27 11:42:47 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Temporary image 19e39e1c-7f83-4acc-8043-8614d79bae2f for user 1a5b183ddd1044f58ac4c206565103f0 is deleted. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 27 11:42:47 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Marking volume 327a9d64-17af-4bc2-9a53-ffede6d2b4ed as bootable. {{(pid=84197) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 27 11:42:47 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Copying metadata from image 19e39e1c-7f83-4acc-8043-8614d79bae2f to 327a9d64-17af-4bc2-9a53-ffede6d2b4ed. {{(pid=84197) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 27 11:42:47 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Creating volume glance metadata for volume 327a9d64-17af-4bc2-9a53-ffede6d2b4ed backed by image 19e39e1c-7f83-4acc-8043-8614d79bae2f with: {'image_id': '19e39e1c-7f83-4acc-8043-8614d79bae2f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a5113bc2468f8e72fa8acbd5c9e5774f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84197) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 27 11:42:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39fa5f1-6360-4f56-b416-8794bf1115db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed', 'volume_size': 1, 'image_id': '19e39e1c-7f83-4acc-8043-8614d79bae2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19e39e1c-7f83-4acc-8043-8614d79bae2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5113bc2468f8e72fa8acbd5c9e5774f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '39483d2da12f4aefbb70147abf271bca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '988aa2d1b3b84042d26bbd9f3674932edc71e51873020728f4d4e370f651b88d5808b1d9cd80beac2d0e066e6af79c943cf72d3486d1e96110deefb3459aea34', 'id': '19e39e1c-7f83-4acc-8043-8614d79bae2f', 'created_at': datetime.datetime(2025, 9, 27, 9, 42, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 9, 42, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19e39e1c-7f83-4acc-8043-8614d79bae2f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce5d587bb0>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1dc7f5-8873-4790-83da-43b1b7b8dec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:42:48 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Volume volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed (327a9d64-17af-4bc2-9a53-ffede6d2b4ed): created successfully
Sep 27 11:42:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1dc7f5-8873-4790-83da-43b1b7b8dec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:42:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Flow 'volume_create_manager' (02247117-0f15-46ed-844e-e30f4e8d78ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:42:48 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e6406c53-a216-4888-ba50-b92facf1e57b tempest-VolumeImageDependencyTests-1861645290 None] Created volume successfully.
Sep 27 11:42:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Acquiring lock "cinder-327a9d64-17af-4bc2-9a53-ffede6d2b4ed-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Lock "cinder-327a9d64-17af-4bc2-9a53-ffede6d2b4ed-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:49 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:42:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Acquiring lock "cinder-quobyte-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:42:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Lock "cinder-quobyte-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" acquired by "delete_volume" :: waited 0.015s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:42:49 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[958fb378-b62f-40d6-93f9-59dfa77ff85a]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:42:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:49 devstack quobyte-client[84221]: System call of process 95152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:42:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" returned: 0 in 0.450s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" returned: 1 in 0.476s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 11:42:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" returned: 0 in 0.097s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Lock "cinder-quobyte-327a9d64-17af-4bc2-9a53-ffede6d2b4ed" released by "delete_volume" :: held 1.273s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:42:50 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Created reservations ['93584a1c-4ded-49f5-927a-61ff3031086c', '0ad504a8-9ca1-4f65-9c21-4b7488fb39cc', '06fef6c6-2d2c-492b-b89b-e3e9848d5b69', 'fac8eeb8-e145-4ce9-a77b-d938a46b0797'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:42:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:42:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:42:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:42:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:42:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:42:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:42:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.098s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:42:51 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:42:51 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Deleted volume successfully.
Sep 27 11:42:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-2fc2a2f8-4139-410a-aa84-4940a71ec3dd tempest-VolumeImageDependencyTests-1861645290 None] Lock "cinder-327a9d64-17af-4bc2-9a53-ffede6d2b4ed-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:01 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=17,cinder:INSERT=11,cinder:UPDATE=10 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:43:01 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=5,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:43:22 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Flow 'volume_create_manager' (454e6d83-5a3e-46e1-b956-66df5a4b7296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e897926f-71d9-46a1-b6b4-35728943e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e897926f-71d9-46a1-b6b4-35728943e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-33158459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035bbdde-1573-481f-9fdf-65102965869d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b19f83a9b649978267a521c0d239cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:43:22Z,use_quota=True,user_id='14db36d874fc419fbe5fba602b1e7695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f58aef-4f06-4b18-962f-68caaaed5b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f58aef-4f06-4b18-962f-68caaaed5b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d8b4a3-a78f-45ce-8233-3c61d61f0aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d8b4a3-a78f-45ce-8233-3c61d61f0aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035bbdde-1573-481f-9fdf-65102965869d', 'volume_name': 'volume-035bbdde-1573-481f-9fdf-65102965869d', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc34da42-c4b1-42fc-8c05-12cb6bc89015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc34da42-c4b1-42fc-8c05-12cb6bc89015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213840cf-d314-4a82-9edd-36401a308cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:22 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Volume 035bbdde-1573-481f-9fdf-65102965869d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035bbdde-1573-481f-9fdf-65102965869d', 'volume_size': 1}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-33158459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035bbdde-1573-481f-9fdf-65102965869d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b19f83a9b649978267a521c0d239cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:43:22Z,use_quota=True,user_id='14db36d874fc419fbe5fba602b1e7695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Creating volume 035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:43:22 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:43:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:22 devstack quobyte-client[84221]: System call of process 95232 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:22 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=95, name=volume-035bbdde-1573-481f-9fdf-65102965869d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:43:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d 1073741824" returned: 0 in 0.418s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d" returned: 0 in 0.114s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] <== create_volume: return (605ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:43:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.617s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213840cf-d314-4a82-9edd-36401a308cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035bbdde-1573-481f-9fdf-65102965869d', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8cb3d0-bf75-4be7-b775-fd9f0bc17fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:23 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Volume volume-035bbdde-1573-481f-9fdf-65102965869d (035bbdde-1573-481f-9fdf-65102965869d): created successfully
Sep 27 11:43:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8cb3d0-bf75-4be7-b775-fd9f0bc17fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Flow 'volume_create_manager' (454e6d83-5a3e-46e1-b956-66df5a4b7296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:43:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-49fc8949-37af-47df-8fab-0901cf436e14 tempest-SnapshotDependencyTests-448817802 None] Created volume successfully.
Sep 27 11:43:25 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:43:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Creating offline snapshot 8ed5befe-e615-4f74-9d73-c0eee835be70 of volume 035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:43:25 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f396cb8-2035-4357-8dcc-96fba5ceecc6]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:43:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:25 devstack quobyte-client[84221]: System call of process 95238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:25 devstack quobyte-client[84221]: System call of process 95238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:25 devstack quobyte-client[84221]: System call of process 95238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d" returned: 0 in 0.483s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:25 devstack quobyte-client[84221]: System call of process 95245 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:25 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=96, name=volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 1G" returned: 0 in 0.326s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): qemu-img rebase -u -b volume-035bbdde-1573-481f-9fdf-65102965869d -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:26 devstack quobyte-client[84221]: System call of process 95249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:26 devstack quobyte-client[84221]: System call of process 95249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:26 devstack quobyte-client[84221]: System call of process 95249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] CMD "qemu-img rebase -u -b volume-035bbdde-1573-481f-9fdf-65102965869d -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70" returned: 0 in 0.277s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70" returned: 0 in 0.126s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70" returned: 0 in 0.109s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.info" returned: 0 in 0.106s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.info" returned: 0 in 0.093s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:27 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c402dcbf-dd0a-450a-95a5-3b446ca55ca3 tempest-SnapshotDependencyTests-448817802 None] Create snapshot completed successfully
Sep 27 11:43:28 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:43:28 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Flow 'volume_create_manager' (c32f05ab-6680-424d-b3d2-6ee4f4c0684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab1acdf-5b3c-499b-bfa0-7e6d0ede19eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab1acdf-5b3c-499b-bfa0-7e6d0ede19eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fff72a8-6d73-444e-afdf-a82679520cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b19f83a9b649978267a521c0d239cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ed5befe-e615-4f74-9d73-c0eee835be70,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:43:29Z,use_quota=True,user_id='14db36d874fc419fbe5fba602b1e7695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11d95b9-afbf-44d8-9cfb-9a2d4e15e06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11d95b9-afbf-44d8-9cfb-9a2d4e15e06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb5a630-3ecc-46e7-9ac3-564988bfd7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb5a630-3ecc-46e7-9ac3-564988bfd7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6fff72a8-6d73-444e-afdf-a82679520cd1', 'volume_name': 'volume-6fff72a8-6d73-444e-afdf-a82679520cd1', 'volume_size': 1, 'snapshot_id': '8ed5befe-e615-4f74-9d73-c0eee835be70'}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbff614b-5651-4a70-9cd1-461cf9734b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbff614b-5651-4a70-9cd1-461cf9734b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589da178-912e-443f-bb2a-327930c6ee93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:29 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Volume 6fff72a8-6d73-444e-afdf-a82679520cd1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6fff72a8-6d73-444e-afdf-a82679520cd1', 'volume_size': 1, 'snapshot_id': '8ed5befe-e615-4f74-9d73-c0eee835be70'}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "cinder-quobyte-8ed5befe-e615-4f74-9d73-c0eee835be70-6fff72a8-6d73-444e-afdf-a82679520cd1" by "_create_volume_from_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-8ed5befe-e615-4f74-9d73-c0eee835be70-6fff72a8-6d73-444e-afdf-a82679520cd1" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Creating volume 6fff72a8-6d73-444e-afdf-a82679520cd1 from snapshot 8ed5befe-e615-4f74-9d73-c0eee835be70 {{(pid=84197) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "cinder-quobyte-6fff72a8-6d73-444e-afdf-a82679520cd1" by "_copy_volume_from_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-6fff72a8-6d73-444e-afdf-a82679520cd1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] snapshot: 8ed5befe-e615-4f74-9d73-c0eee835be70, volume: 6fff72a8-6d73-444e-afdf-a82679520cd1,  {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0122381a-4507-4606-ab55-5563a4613dde]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70" returned: 0 in 0.475s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-035bbdde-1573-481f-9fdf-65102965869d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Creating direct copy from snapshot {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f7542e-1503-424b-899a-7cada3cd3ec0]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:43:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:30 devstack quobyte-client[84221]: System call of process 95270 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d" returned: 0 in 0.452s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:30 devstack cinder-volume[84197]: DEBUG cinder.utils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1 not found in is_blk_device check {{(pid=84197) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 27 11:43:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:30 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=98, name=volume-6fff72a8-6d73-444e-afdf-a82679520cd1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:43:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1" returned: 0 in 7.522s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:37 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf438931-d3af-4652-bc91-ea1d1a8e9b4d]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:43:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d" returned: 0 in 0.592s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:38 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1 {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:43:38 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Converted 1024.00 MB image at 135.76 MB/s
Sep 27 11:43:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:43:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1" returned: 0 in 0.114s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-6fff72a8-6d73-444e-afdf-a82679520cd1" released by "_copy_volume_from_snapshot" :: held 9.559s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-8ed5befe-e615-4f74-9d73-c0eee835be70-6fff72a8-6d73-444e-afdf-a82679520cd1" released by "_create_volume_from_snapshot" :: held 9.603s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.633s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589da178-912e-443f-bb2a-327930c6ee93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fff72a8-6d73-444e-afdf-a82679520cd1', 'volume_size': 1, 'snapshot_id': '8ed5befe-e615-4f74-9d73-c0eee835be70'}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd335699-5b2b-40ab-abb7-7a136d133c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:39 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Volume volume-6fff72a8-6d73-444e-afdf-a82679520cd1 (6fff72a8-6d73-444e-afdf-a82679520cd1): created successfully
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd335699-5b2b-40ab-abb7-7a136d133c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Flow 'volume_create_manager' (c32f05ab-6680-424d-b3d2-6ee4f4c0684c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:43:39 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-525f5d30-2080-44b7-9604-b986cd671003 tempest-SnapshotDependencyTests-448817802 None] Created volume successfully.
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.101s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "cinder-8ed5befe-e615-4f74-9d73-c0eee835be70-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-8ed5befe-e615-4f74-9d73-c0eee835be70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:43:40 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "cinder-quobyte-035bbdde-1573-481f-9fdf-65102965869d" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-035bbdde-1573-481f-9fdf-65102965869d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "cinder-quobyte-8ed5befe-e615-4f74-9d73-c0eee835be70" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-8ed5befe-e615-4f74-9d73-c0eee835be70" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Deleting offline snapshot 8ed5befe-e615-4f74-9d73-c0eee835be70 of volume 035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] snapshot_file for this snap is: volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ff43c9-9429-4bb0-9200-64833b365bd0]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:43:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70" returned: 0 in 0.465s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-035bbdde-1573-481f-9fdf-65102965869d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:43:41 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[705089ae-263f-4a61-bbf2-65f033199443]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:43:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d" returned: 0 in 0.449s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70" returned: 0 in 0.231s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d.8ed5befe-e615-4f74-9d73-c0eee835be70" returned: 0 in 0.103s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-8ed5befe-e615-4f74-9d73-c0eee835be70" released by "_delete_snapshot" :: held 1.578s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-035bbdde-1573-481f-9fdf-65102965869d" released by "delete_snapshot" :: held 1.612s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:42 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Created reservations ['f9609f4c-4119-490a-bf03-f2e8cbae4840', '622ef4aa-b76a-4c18-a8bf-ad369a8dee59', 'f9aa7000-8e02-458f-ba69-02ff04ab49c2', '228a0e23-d9d6-426d-814e-9101acaa3a74'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:43:42 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Delete snapshot completed successfully.
Sep 27 11:43:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b61d2ff0-6d04-40dc-a094-99871de18606 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-8ed5befe-e615-4f74-9d73-c0eee835be70-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "cinder-035bbdde-1573-481f-9fdf-65102965869d-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-035bbdde-1573-481f-9fdf-65102965869d-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:43:43 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Flow 'volume_create_manager' (71c1f075-7d8c-4a63-b1e8-9af6ac0ecec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1704f8-a179-47a1-b611-1ee023e635d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1704f8-a179-47a1-b611-1ee023e635d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1482425334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31175a344d846e384f626a1554018ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:43:44Z,use_quota=True,user_id='53fbac6938d1408d9daac8d788438cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46190a03-c6c5-48cd-bfdf-9f62164029ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46190a03-c6c5-48cd-bfdf-9f62164029ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8577097f-0809-498a-8b48-6ad3717aa332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8577097f-0809-498a-8b48-6ad3717aa332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f', 'volume_name': 'volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74637342-27e0-4348-8b1c-d045be6aed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74637342-27e0-4348-8b1c-d045be6aed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9bd4c6-e049-438a-8429-d147ffd41482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:44 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Volume 2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f', 'volume_size': 1}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1482425334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31175a344d846e384f626a1554018ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:43:44Z,use_quota=True,user_id='53fbac6938d1408d9daac8d788438cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Creating volume 2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:43:44 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:44 devstack quobyte-client[84221]: System call of process 95302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:44 devstack quobyte-client[84221]: System call of process 95302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:44 devstack quobyte-client[84221]: System call of process 95302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:44 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=99, name=volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:43:44 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "cinder-quobyte-035bbdde-1573-481f-9fdf-65102965869d" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-035bbdde-1573-481f-9fdf-65102965869d" acquired by "delete_volume" :: waited 0.060s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f 1073741824" returned: 0 in 0.552s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[c335b588-e01d-43e7-b406-f05b7d296e1b]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f" returned: 0 in 0.266s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] <== create_volume: return (888ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:43:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9bd4c6-e049-438a-8429-d147ffd41482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb9afc0-d2d3-4c93-b2a8-24498deb0e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:43:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Volume volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f (2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f): created successfully
Sep 27 11:43:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb9afc0-d2d3-4c93-b2a8-24498deb0e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:43:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Flow 'volume_create_manager' (71c1f075-7d8c-4a63-b1e8-9af6ac0ecec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:43:45 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-059386fd-6180-40fc-b8d5-3a4da6294117 tempest-AttachVolumeTestJSON-1449472356 None] Created volume successfully.
Sep 27 11:43:45 devstack quobyte-client[84221]: System call of process 95306 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d" returned: 0 in 0.643s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-035bbdde-1573-481f-9fdf-65102965869d" returned: 0 in 0.099s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-035bbdde-1573-481f-9fdf-65102965869d" released by "delete_volume" :: held 1.097s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:45 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Created reservations ['8f7a1f53-7907-491f-a414-162387dca096', '88ec54c5-301b-4650-8355-1d3608b46144', 'b9c64622-1554-412a-a6e9-6a7aa0ae0d0f', '69b7d188-379b-4632-a924-cb6556d643f5'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:43:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:43:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:43:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.119s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:46 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:43:46 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Deleted volume successfully.
Sep 27 11:43:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0af2a4bc-6471-44bc-b8d3-0d6de79633e5 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-035bbdde-1573-481f-9fdf-65102965869d-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "cinder-6fff72a8-6d73-444e-afdf-a82679520cd1-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:43:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-6fff72a8-6d73-444e-afdf-a82679520cd1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:43:47 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:43:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "cinder-quobyte-6fff72a8-6d73-444e-afdf-a82679520cd1" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:43:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-6fff72a8-6d73-444e-afdf-a82679520cd1" acquired by "delete_volume" :: waited 0.010s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:43:47 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f00f023-12c8-4e7f-a4bf-8f87e104f77d]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:43:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:47 devstack quobyte-client[84221]: System call of process 95312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1" returned: 0 in 0.421s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6fff72a8-6d73-444e-afdf-a82679520cd1" returned: 0 in 0.111s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-quobyte-6fff72a8-6d73-444e-afdf-a82679520cd1" released by "delete_volume" :: held 0.670s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Created reservations ['9d6cce96-ea7d-45a5-85ad-bc25e4e311d1', '2ff9b420-5ff2-45c6-9dab-190caff15c53', '323aa81f-caa6-4ac3-952d-cdc2f5113fa1', 'bed1d385-2229-4929-a832-93270f9888c4'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.158s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:43:48 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Deleted volume successfully.
Sep 27 11:43:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ce1d56b2-8ce0-4ded-b8f5-aea06339f222 tempest-SnapshotDependencyTests-448817802 None] Lock "cinder-6fff72a8-6d73-444e-afdf-a82679520cd1-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:43:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-cfbc34fd-4fb2-4b03-933d-148ded6cc96d req-5014e29b-988f-40a2-8b0d-1d1a2efc444d tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:43:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-cfbc34fd-4fb2-4b03-933d-148ded6cc96d req-5014e29b-988f-40a2-8b0d-1d1a2efc444d tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:43:50 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f58ac2-46ba-4a5c-910e-704a3d96779f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:43:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-cfbc34fd-4fb2-4b03-933d-148ded6cc96d req-5014e29b-988f-40a2-8b0d-1d1a2efc444d tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:43:50 devstack quobyte-client[84221]: System call of process 95325 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:43:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-cfbc34fd-4fb2-4b03-933d-148ded6cc96d req-5014e29b-988f-40a2-8b0d-1d1a2efc444d tempest-AttachVolumeTestJSON-1449472356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f" returned: 0 in 0.567s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:43:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-cfbc34fd-4fb2-4b03-933d-148ded6cc96d req-5014e29b-988f-40a2-8b0d-1d1a2efc444d tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.625s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:43:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-cfbc34fd-4fb2-4b03-933d-148ded6cc96d req-5014e29b-988f-40a2-8b0d-1d1a2efc444d tempest-AttachVolumeTestJSON-1449472356 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2d0bb9b-78e6-4fee-b6d4-5d93cf022647', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:43:50 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-cfbc34fd-4fb2-4b03-933d-148ded6cc96d req-5014e29b-988f-40a2-8b0d-1d1a2efc444d tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:43:51 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-cfbc34fd-4fb2-4b03-933d-148ded6cc96d req-5014e29b-988f-40a2-8b0d-1d1a2efc444d tempest-AttachVolumeTestJSON-1449472356 None] attachment_update completed successfully.
Sep 27 11:44:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Flow 'volume_create_manager' (da1456d1-0a4c-4957-a46a-0d58d90b69ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d4bd7a-0ee7-42bb-b8a9-2e563d1edb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d4bd7a-0ee7-42bb-b8a9-2e563d1edb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-531600689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd4e581-728b-4f29-ab0c-a7511c3cd94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31175a344d846e384f626a1554018ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:44:01Z,use_quota=True,user_id='53fbac6938d1408d9daac8d788438cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2ee44e-0f2b-4ab7-8130-32e7150ac9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2ee44e-0f2b-4ab7-8130-32e7150ac9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23213950-98cb-4274-881e-0ac98fa0ab39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23213950-98cb-4274-881e-0ac98fa0ab39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd4e581-728b-4f29-ab0c-a7511c3cd94d', 'volume_name': 'volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1882211-75c5-4499-afb9-cd347840ba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1882211-75c5-4499-afb9-cd347840ba93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8246c8b-8016-45cc-b44a-9568e19173cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:44:00 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Volume bbd4e581-728b-4f29-ab0c-a7511c3cd94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d', 'volume_size': 1}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-531600689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd4e581-728b-4f29-ab0c-a7511c3cd94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31175a344d846e384f626a1554018ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:44:01Z,use_quota=True,user_id='53fbac6938d1408d9daac8d788438cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Creating volume bbd4e581-728b-4f29-ab0c-a7511c3cd94d {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:44:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:44:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:44:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:44:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:44:01 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:44:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:44:01 devstack quobyte-client[84221]: System call of process 95760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:44:01 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=100, name=volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:44:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d 1073741824" returned: 0 in 0.608s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:44:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:44:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d" returned: 0 in 0.102s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:44:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] <== create_volume: return (791ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:44:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:44:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8246c8b-8016-45cc-b44a-9568e19173cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:44:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351257f6-bf97-44f5-9260-e64bdb33bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:44:02 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Volume volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d (bbd4e581-728b-4f29-ab0c-a7511c3cd94d): created successfully
Sep 27 11:44:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351257f6-bf97-44f5-9260-e64bdb33bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:44:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Flow 'volume_create_manager' (da1456d1-0a4c-4957-a46a-0d58d90b69ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:44:02 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1cf5d0ac-8c69-4bb6-9217-c2d53d43e7ce tempest-AttachVolumeTestJSON-1449472356 None] Created volume successfully.
Sep 27 11:44:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-2943a3b0-be76-45c3-840b-443d59a7d619 req-aea8b795-1ec7-4413-a1e4-7c7b8e700c5d tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:44:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-2943a3b0-be76-45c3-840b-443d59a7d619 req-aea8b795-1ec7-4413-a1e4-7c7b8e700c5d tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:44:07 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[642d9327-8106-4b33-91d7-225a520b856a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:44:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-2943a3b0-be76-45c3-840b-443d59a7d619 req-aea8b795-1ec7-4413-a1e4-7c7b8e700c5d tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:44:07 devstack quobyte-client[84221]: System call of process 95779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:44:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-2943a3b0-be76-45c3-840b-443d59a7d619 req-aea8b795-1ec7-4413-a1e4-7c7b8e700c5d tempest-AttachVolumeTestJSON-1449472356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d" returned: 0 in 0.490s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:44:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-2943a3b0-be76-45c3-840b-443d59a7d619 req-aea8b795-1ec7-4413-a1e4-7c7b8e700c5d tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.558s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:44:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-2943a3b0-be76-45c3-840b-443d59a7d619 req-aea8b795-1ec7-4413-a1e4-7c7b8e700c5d tempest-AttachVolumeTestJSON-1449472356 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54900586-2310-436b-a7a2-3d4501bdeda3', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:44:08 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-2943a3b0-be76-45c3-840b-443d59a7d619 req-aea8b795-1ec7-4413-a1e4-7c7b8e700c5d tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:44:08 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-2943a3b0-be76-45c3-840b-443d59a7d619 req-aea8b795-1ec7-4413-a1e4-7c7b8e700c5d tempest-AttachVolumeTestJSON-1449472356 None] attachment_update completed successfully.
Sep 27 11:44:18 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=35,cinder:DELETE=3,cinder:SELECT=33,cinder:INSERT=7 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:44:18 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=33,cinder:UPDATE=33,cinder:DELETE=4,cinder:INSERT=5 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:44:35 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-5a55f043-560c-4174-be63-35f51ae679c2 req-ab852af5-a6e9-4e50-b05b-28680d60056a tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:44:35 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-5a55f043-560c-4174-be63-35f51ae679c2 req-ab852af5-a6e9-4e50-b05b-28680d60056a tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:44:35 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-5a55f043-560c-4174-be63-35f51ae679c2 req-ab852af5-a6e9-4e50-b05b-28680d60056a tempest-AttachVolumeTestJSON-1449472356 None] Terminate volume connection completed successfully.
Sep 27 11:44:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-5a55f043-560c-4174-be63-35f51ae679c2 req-ab852af5-a6e9-4e50-b05b-28680d60056a tempest-AttachVolumeTestJSON-1449472356 None] Deleting attachment d2d0bb9b-78e6-4fee-b6d4-5d93cf022647. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:44:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:44:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:44:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:44:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:44:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:44:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:44:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:44:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.118s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:44:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:44:45 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:45:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-957f66c7-d34d-4b25-9f75-ae5e8e8624b0 req-17910140-5f58-4a22-888c-cdde6de46609 tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:45:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-957f66c7-d34d-4b25-9f75-ae5e8e8624b0 req-17910140-5f58-4a22-888c-cdde6de46609 tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:45:00 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-957f66c7-d34d-4b25-9f75-ae5e8e8624b0 req-17910140-5f58-4a22-888c-cdde6de46609 tempest-AttachVolumeTestJSON-1449472356 None] Terminate volume connection completed successfully.
Sep 27 11:45:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-957f66c7-d34d-4b25-9f75-ae5e8e8624b0 req-17910140-5f58-4a22-888c-cdde6de46609 tempest-AttachVolumeTestJSON-1449472356 None] Deleting attachment 54900586-2310-436b-a7a2-3d4501bdeda3. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:45:10 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:45:10 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:45:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "cinder-bbd4e581-728b-4f29-ab0c-a7511c3cd94d-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:45:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-bbd4e581-728b-4f29-ab0c-a7511c3cd94d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:45:12 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:45:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "cinder-quobyte-bbd4e581-728b-4f29-ab0c-a7511c3cd94d" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:45:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-quobyte-bbd4e581-728b-4f29-ab0c-a7511c3cd94d" acquired by "delete_volume" :: waited 0.028s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:45:12 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[161116cc-aea6-4d0d-9df9-8ae3a6470145]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:45:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:12 devstack quobyte-client[84221]: System call of process 95944 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:45:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d" returned: 0 in 0.444s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-bbd4e581-728b-4f29-ab0c-a7511c3cd94d" returned: 0 in 0.092s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-quobyte-bbd4e581-728b-4f29-ab0c-a7511c3cd94d" released by "delete_volume" :: held 0.689s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Created reservations ['6b49f10f-a14f-44dd-b340-bbe03af5e978', 'c908300a-7c3e-446e-b889-c41845ddb652', 'ad2039be-33d7-47ff-b49e-71967f9dfd71', '966b70d6-411c-4646-9ef4-89ef0a79f2b5'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.123s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:45:13 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Deleted volume successfully.
Sep 27 11:45:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60a46d72-a367-4fa3-b2ad-a94a5fc96f4c tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-bbd4e581-728b-4f29-ab0c-a7511c3cd94d-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:45:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "cinder-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:45:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:45:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:45:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "cinder-quobyte-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:45:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-quobyte-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f" acquired by "delete_volume" :: waited 0.014s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:45:14 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6327e1-eba4-4c21-ba09-80123bb3b9f1]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:45:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f" returned: 0 in 0.393s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f" returned: 0 in 0.093s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:15 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-quobyte-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f" released by "delete_volume" :: held 0.644s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:45:16 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Created reservations ['7deb2807-f5d2-43af-b37a-883dd744d3bd', '139166d2-4742-4b07-bfd5-cde7004362ed', '4d669d3e-48a4-48a7-8a73-27ddb701c821', '7a8fb5bd-c1a7-4524-a436-0fd8a5724d99'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:45:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:45:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:45:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:45:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:45:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:45:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.129s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:16 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:45:16 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Deleted volume successfully.
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "cinder-aec29e9f-9147-4829-b089-d130a4f5e9d7-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-445c4703-6a16-45ea-aa04-2e0b992f104c tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-2ae550a2-40b1-4a42-9ae4-a96e2fd38e5f-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-aec29e9f-9147-4829-b089-d130a4f5e9d7-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:45:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "cinder-quobyte-aec29e9f-9147-4829-b089-d130a4f5e9d7" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-quobyte-aec29e9f-9147-4829-b089-d130a4f5e9d7" acquired by "delete_volume" :: waited 0.015s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13d9192-4bf0-46b4-ac56-821e1b104dd4]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:17 devstack quobyte-client[84221]: System call of process 95955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7" returned: 0 in 0.424s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-aec29e9f-9147-4829-b089-d130a4f5e9d7" returned: 0 in 0.092s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-quobyte-aec29e9f-9147-4829-b089-d130a4f5e9d7" released by "delete_volume" :: held 0.683s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Created reservations ['1c7979e2-c5ba-498a-a22c-2735fa851e88', '8029ebe1-2265-447f-afd0-a6de5fa0af02', '98fa17b0-f613-4ee9-83b7-63e7050bc5d1', 'cc030797-3784-4be8-bae0-84f25213347f'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:45:18 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Deleted volume successfully.
Sep 27 11:45:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6254f093-896b-4724-8a63-5633c0582b4e tempest-AttachVolumeTestJSON-1449472356 None] Lock "cinder-aec29e9f-9147-4829-b089-d130a4f5e9d7-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:45:28 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=13,cinder:INSERT=9,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:45:28 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=17,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:45:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:45:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:45:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:45:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:45:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:45:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:45:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:45:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.113s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:45:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:45:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:45:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:46:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:46:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:46:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:46:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:46:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:46:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:46:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:46:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.081s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:46:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:47:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Flow 'volume_create_manager' (debd91c3-8474-4675-9270-90d46974f36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545f5b2c-d674-430b-bcdc-6417fa07c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545f5b2c-d674-430b-bcdc-6417fa07c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-809357545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb91b8d8-7919-45f8-a03d-61d876337a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31496e9f04de4757915de02967ca5e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:47:10Z,use_quota=True,user_id='9403e3ed303f4186a97cda656726777d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ab56bf-9132-419d-a731-bf50cc126830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ab56bf-9132-419d-a731-bf50cc126830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1008f8-dd06-4e89-9ca4-bab49d16807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1008f8-dd06-4e89-9ca4-bab49d16807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb91b8d8-7919-45f8-a03d-61d876337a06', 'volume_name': 'volume-cb91b8d8-7919-45f8-a03d-61d876337a06', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26de561d-168d-4324-97da-7c18ca8b0a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26de561d-168d-4324-97da-7c18ca8b0a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53ac23d-d1f9-4687-b8f1-089a2b5e44aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:47:10 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Volume cb91b8d8-7919-45f8-a03d-61d876337a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb91b8d8-7919-45f8-a03d-61d876337a06', 'volume_size': 1}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-809357545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb91b8d8-7919-45f8-a03d-61d876337a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31496e9f04de4757915de02967ca5e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:47:10Z,use_quota=True,user_id='9403e3ed303f4186a97cda656726777d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Creating volume cb91b8d8-7919-45f8-a03d-61d876337a06 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:47:10 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:47:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:47:11 devstack quobyte-client[84221]: System call of process 96214 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:47:11 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=101, name=volume-cb91b8d8-7919-45f8-a03d-61d876337a06, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:47:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06 1073741824" returned: 0 in 0.420s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:47:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:47:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06" returned: 0 in 0.101s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:47:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] <== create_volume: return (591ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:47:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.602s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:47:11 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53ac23d-d1f9-4687-b8f1-089a2b5e44aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb91b8d8-7919-45f8-a03d-61d876337a06', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:47:11 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58bae80-5beb-4100-9a8c-2840b16a3805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:47:11 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Volume volume-cb91b8d8-7919-45f8-a03d-61d876337a06 (cb91b8d8-7919-45f8-a03d-61d876337a06): created successfully
Sep 27 11:47:11 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58bae80-5beb-4100-9a8c-2840b16a3805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:47:11 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Flow 'volume_create_manager' (debd91c3-8474-4675-9270-90d46974f36b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:47:11 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-61a0f9c7-fb97-4077-94ac-4b405ed1a76d tempest-AttachVolumeNegativeTest-1614629583 None] Created volume successfully.
Sep 27 11:47:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-d53c2104-34c7-4efc-bab3-edf554b4be51 req-66a00662-8554-4a13-acb8-269e52ca4ca8 tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:47:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-d53c2104-34c7-4efc-bab3-edf554b4be51 req-66a00662-8554-4a13-acb8-269e52ca4ca8 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:47:16 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[29229671-7498-457c-8c26-c10fe4336d23]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:47:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-d53c2104-34c7-4efc-bab3-edf554b4be51 req-66a00662-8554-4a13-acb8-269e52ca4ca8 tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:47:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-d53c2104-34c7-4efc-bab3-edf554b4be51 req-66a00662-8554-4a13-acb8-269e52ca4ca8 tempest-AttachVolumeNegativeTest-1614629583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06" returned: 0 in 0.484s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:47:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-d53c2104-34c7-4efc-bab3-edf554b4be51 req-66a00662-8554-4a13-acb8-269e52ca4ca8 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.545s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:47:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-d53c2104-34c7-4efc-bab3-edf554b4be51 req-66a00662-8554-4a13-acb8-269e52ca4ca8 tempest-AttachVolumeNegativeTest-1614629583 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-cb91b8d8-7919-45f8-a03d-61d876337a06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1f438d9-1a2b-4b40-9859-b08220b218f8', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:47:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-d53c2104-34c7-4efc-bab3-edf554b4be51 req-66a00662-8554-4a13-acb8-269e52ca4ca8 tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:47:17 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-d53c2104-34c7-4efc-bab3-edf554b4be51 req-66a00662-8554-4a13-acb8-269e52ca4ca8 tempest-AttachVolumeNegativeTest-1614629583 None] attachment_update completed successfully.
Sep 27 11:47:27 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:47:27 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:47:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:47:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:47:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:47:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:47:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:47:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:47:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:47:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.105s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:47:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:47:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:48:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:48:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:48:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:48:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:48:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:48:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:48:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:48:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:48:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:49:32 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-bb393ab5-ce36-4ad2-be0a-a5be33a77e7f req-72307d81-dcb6-4d11-b937-9ddbef57d429 tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:49:32 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-bb393ab5-ce36-4ad2-be0a-a5be33a77e7f req-72307d81-dcb6-4d11-b937-9ddbef57d429 tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:49:32 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-bb393ab5-ce36-4ad2-be0a-a5be33a77e7f req-72307d81-dcb6-4d11-b937-9ddbef57d429 tempest-AttachVolumeNegativeTest-1614629583 None] Terminate volume connection completed successfully.
Sep 27 11:49:32 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-bb393ab5-ce36-4ad2-be0a-a5be33a77e7f req-72307d81-dcb6-4d11-b937-9ddbef57d429 tempest-AttachVolumeNegativeTest-1614629583 None] Deleting attachment c1f438d9-1a2b-4b40-9859-b08220b218f8. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:49:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:49:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:49:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:49:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:49:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:49:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:49:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:49:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.082s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:49:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:49:42 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:49:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:50:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:50:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:50:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:50:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:50:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:50:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:50:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:50:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.096s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:50:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:51:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Flow 'volume_create_manager' (a2252100-d258-42e7-b212-f2ff56334d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39941ba-9a4e-4014-bcbc-58607ffc0108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39941ba-9a4e-4014-bcbc-58607ffc0108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1153505260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d3a721-fdd8-48ab-88d7-3d3b85aca78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31496e9f04de4757915de02967ca5e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:51:17Z,use_quota=True,user_id='9403e3ed303f4186a97cda656726777d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f9cc75-5be7-4494-979c-5dd5da44bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f9cc75-5be7-4494-979c-5dd5da44bde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3016ee-c716-411a-b000-665452f63dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3016ee-c716-411a-b000-665452f63dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d3a721-fdd8-48ab-88d7-3d3b85aca78a', 'volume_name': 'volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721dedb4-c627-4409-a3d8-0360f0410f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721dedb4-c627-4409-a3d8-0360f0410f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099c7271-90f5-427c-8f92-3aee7f5f5428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:51:17 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Volume c7d3a721-fdd8-48ab-88d7-3d3b85aca78a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a', 'volume_size': 1}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1153505260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d3a721-fdd8-48ab-88d7-3d3b85aca78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31496e9f04de4757915de02967ca5e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:51:17Z,use_quota=True,user_id='9403e3ed303f4186a97cda656726777d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Creating volume c7d3a721-fdd8-48ab-88d7-3d3b85aca78a {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:51:17 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:51:17 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=102, name=volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a 1073741824" returned: 0 in 0.380s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a" returned: 0 in 0.079s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] <== create_volume: return (525ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:51:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.537s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:51:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099c7271-90f5-427c-8f92-3aee7f5f5428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:51:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d315d66-1489-4518-9b8a-8b0120e093b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:51:18 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Volume volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a (c7d3a721-fdd8-48ab-88d7-3d3b85aca78a): created successfully
Sep 27 11:51:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d315d66-1489-4518-9b8a-8b0120e093b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:51:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Flow 'volume_create_manager' (a2252100-d258-42e7-b212-f2ff56334d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:51:18 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0b381c69-679e-418e-a566-c1346b6a7493 tempest-AttachVolumeNegativeTest-1614629583 None] Created volume successfully.
Sep 27 11:51:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-26d5e138-f4b3-4224-a15c-8918cca46d96 req-537ee509-6bf8-4eb5-89ed-56c344fa8896 tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:51:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-26d5e138-f4b3-4224-a15c-8918cca46d96 req-537ee509-6bf8-4eb5-89ed-56c344fa8896 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:51:23 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[7102b79e-1f3f-484e-9860-9ae6b4de8a4e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:51:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-26d5e138-f4b3-4224-a15c-8918cca46d96 req-537ee509-6bf8-4eb5-89ed-56c344fa8896 tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:51:23 devstack quobyte-client[84221]: System call of process 97255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:51:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-26d5e138-f4b3-4224-a15c-8918cca46d96 req-537ee509-6bf8-4eb5-89ed-56c344fa8896 tempest-AttachVolumeNegativeTest-1614629583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a" returned: 0 in 0.419s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:51:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-26d5e138-f4b3-4224-a15c-8918cca46d96 req-537ee509-6bf8-4eb5-89ed-56c344fa8896 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.474s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:51:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-26d5e138-f4b3-4224-a15c-8918cca46d96 req-537ee509-6bf8-4eb5-89ed-56c344fa8896 tempest-AttachVolumeNegativeTest-1614629583 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2886ba48-d6a1-4539-a5e8-09cbc1ddea85', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:51:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-26d5e138-f4b3-4224-a15c-8918cca46d96 req-537ee509-6bf8-4eb5-89ed-56c344fa8896 tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:51:24 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-26d5e138-f4b3-4224-a15c-8918cca46d96 req-537ee509-6bf8-4eb5-89ed-56c344fa8896 tempest-AttachVolumeNegativeTest-1614629583 None] attachment_update completed successfully.
Sep 27 11:51:34 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:51:34 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=4 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:51:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:51:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:51:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:51:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:51:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:51:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:51:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:51:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.082s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:51:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:51:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:51:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:51:51 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-2947ebf8-91eb-4c44-8c69-a5b62043af8e req-4f0ea621-8550-4f3d-9efc-2f5182b63bfa tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:51:52 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-2947ebf8-91eb-4c44-8c69-a5b62043af8e req-4f0ea621-8550-4f3d-9efc-2f5182b63bfa tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:51:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-2947ebf8-91eb-4c44-8c69-a5b62043af8e req-4f0ea621-8550-4f3d-9efc-2f5182b63bfa tempest-AttachVolumeNegativeTest-1614629583 None] Terminate volume connection completed successfully.
Sep 27 11:51:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-2947ebf8-91eb-4c44-8c69-a5b62043af8e req-4f0ea621-8550-4f3d-9efc-2f5182b63bfa tempest-AttachVolumeNegativeTest-1614629583 None] Deleting attachment 2886ba48-d6a1-4539-a5e8-09cbc1ddea85. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:52:02 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:52:02 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:52:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:52:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:52:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:52:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:52:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:52:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:52:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:52:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.103s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:52:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:53:36 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Flow 'volume_create_manager' (047bcbef-91b7-4032-8d3c-a67c70576ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9622a505-b0a3-4729-ae7f-2857412e843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9622a505-b0a3-4729-ae7f-2857412e843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1311597681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9b800c-a07d-4271-8411-453bf2c19b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31496e9f04de4757915de02967ca5e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:53:36Z,use_quota=True,user_id='9403e3ed303f4186a97cda656726777d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868fcda9-0e37-4feb-bfa2-2734395cfaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868fcda9-0e37-4feb-bfa2-2734395cfaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b7d4ab-34e9-41ba-8ea0-e58e543f12ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b7d4ab-34e9-41ba-8ea0-e58e543f12ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9b800c-a07d-4271-8411-453bf2c19b64', 'volume_name': 'volume-9d9b800c-a07d-4271-8411-453bf2c19b64', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d8195d-54f1-452c-8c75-6530dcae5afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d8195d-54f1-452c-8c75-6530dcae5afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590d3b24-03bf-4e11-a514-a8ae03ba8c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:53:36 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Volume 9d9b800c-a07d-4271-8411-453bf2c19b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9b800c-a07d-4271-8411-453bf2c19b64', 'volume_size': 1}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1311597681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9b800c-a07d-4271-8411-453bf2c19b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31496e9f04de4757915de02967ca5e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:53:36Z,use_quota=True,user_id='9403e3ed303f4186a97cda656726777d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Creating volume 9d9b800c-a07d-4271-8411-453bf2c19b64 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:53:36 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:53:36 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=103, name=volume-9d9b800c-a07d-4271-8411-453bf2c19b64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64 1073741824" returned: 0 in 0.394s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64" returned: 0 in 0.101s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] <== create_volume: return (557ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.568s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590d3b24-03bf-4e11-a514-a8ae03ba8c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9b800c-a07d-4271-8411-453bf2c19b64', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:53:36 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1e7796-60f0-4cfe-bd45-c9e823ed0305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:53:37 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Volume volume-9d9b800c-a07d-4271-8411-453bf2c19b64 (9d9b800c-a07d-4271-8411-453bf2c19b64): created successfully
Sep 27 11:53:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1e7796-60f0-4cfe-bd45-c9e823ed0305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:53:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Flow 'volume_create_manager' (047bcbef-91b7-4032-8d3c-a67c70576ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:53:37 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-5bfcdf6e-9035-44e8-bff2-579c2b708a8f tempest-AttachVolumeNegativeTest-1614629583 None] Created volume successfully.
Sep 27 11:53:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:53:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:53:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:53:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:53:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:53:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:53:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:53:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.099s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:53:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:53:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-5ec67253-2e21-410d-876e-983e16767898 req-a68d6a0b-2ba0-4a19-b6fd-abaa0c126765 tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:53:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-5ec67253-2e21-410d-876e-983e16767898 req-a68d6a0b-2ba0-4a19-b6fd-abaa0c126765 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:53:42 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7ebcf1-efef-4ce2-b375-dac98c860c57]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:53:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-5ec67253-2e21-410d-876e-983e16767898 req-a68d6a0b-2ba0-4a19-b6fd-abaa0c126765 tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:53:42 devstack quobyte-client[84221]: System call of process 98020 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:53:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-5ec67253-2e21-410d-876e-983e16767898 req-a68d6a0b-2ba0-4a19-b6fd-abaa0c126765 tempest-AttachVolumeNegativeTest-1614629583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64" returned: 0 in 0.435s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:53:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-5ec67253-2e21-410d-876e-983e16767898 req-a68d6a0b-2ba0-4a19-b6fd-abaa0c126765 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.493s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:53:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-5ec67253-2e21-410d-876e-983e16767898 req-a68d6a0b-2ba0-4a19-b6fd-abaa0c126765 tempest-AttachVolumeNegativeTest-1614629583 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-9d9b800c-a07d-4271-8411-453bf2c19b64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1c8309e-e624-4295-bb4b-2d0f2f12da61', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:53:42 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-5ec67253-2e21-410d-876e-983e16767898 req-a68d6a0b-2ba0-4a19-b6fd-abaa0c126765 tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:53:42 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-5ec67253-2e21-410d-876e-983e16767898 req-a68d6a0b-2ba0-4a19-b6fd-abaa0c126765 tempest-AttachVolumeNegativeTest-1614629583 None] attachment_update completed successfully.
Sep 27 11:53:52 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:53:52 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:54:11 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-408c7a5b-44ba-48e7-a5ff-9f0da80b3fab req-33a1a83c-0e31-4dd1-8a2c-eecc32ba12cf tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:11 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-408c7a5b-44ba-48e7-a5ff-9f0da80b3fab req-33a1a83c-0e31-4dd1-8a2c-eecc32ba12cf tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:11 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-408c7a5b-44ba-48e7-a5ff-9f0da80b3fab req-33a1a83c-0e31-4dd1-8a2c-eecc32ba12cf tempest-AttachVolumeNegativeTest-1614629583 None] Terminate volume connection completed successfully.
Sep 27 11:54:11 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-408c7a5b-44ba-48e7-a5ff-9f0da80b3fab req-33a1a83c-0e31-4dd1-8a2c-eecc32ba12cf tempest-AttachVolumeNegativeTest-1614629583 None] Deleting attachment c1c8309e-e624-4295-bb4b-2d0f2f12da61. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 11:54:21 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:54:21 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:54:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "cinder-9d9b800c-a07d-4271-8411-453bf2c19b64-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-9d9b800c-a07d-4271-8411-453bf2c19b64-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "cinder-quobyte-9d9b800c-a07d-4271-8411-453bf2c19b64" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-quobyte-9d9b800c-a07d-4271-8411-453bf2c19b64" acquired by "delete_volume" :: waited 0.021s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:23 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46278ef-1007-44d1-8203-21ec071f2136]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64" returned: 0 in 0.412s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d9b800c-a07d-4271-8411-453bf2c19b64" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-quobyte-9d9b800c-a07d-4271-8411-453bf2c19b64" released by "delete_volume" :: held 0.657s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:23 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Created reservations ['c8ad207c-ce82-47d2-8f86-e1b6f82bd86f', '94f8994a-a680-467f-bf63-749085e9b6ad', '9c291073-6039-4ab6-b07f-0cc716f24a09', '47a38034-892f-42bc-b813-743b1b95f28d'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.098s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:54:24 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Deleted volume successfully.
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "cinder-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-a08a3372-8161-4207-9a69-c4c89e49408e tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-9d9b800c-a07d-4271-8411-453bf2c19b64-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "cinder-quobyte-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-quobyte-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a" acquired by "delete_volume" :: waited 0.013s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d618afb-6193-4ab0-a9cb-e3a5173bbf25]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a" returned: 0 in 0.404s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a" returned: 0 in 0.093s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-quobyte-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a" released by "delete_volume" :: held 0.645s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Created reservations ['acdedec5-cefe-48ad-8b5f-c1d02a37fa70', '01c8fd49-064b-47ab-8203-b6d0eef92701', 'dbb0b19f-1709-4c85-883b-2c0c7e966042', '9deeeb1f-7fbb-4c86-935e-a98273e8a8ec'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.088s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:25 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:54:25 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Deleted volume successfully.
Sep 27 11:54:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c61bc62c-2a35-4bc1-b657-f77f0ad1dfac tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-c7d3a721-fdd8-48ab-88d7-3d3b85aca78a-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "cinder-cb91b8d8-7919-45f8-a03d-61d876337a06-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-cb91b8d8-7919-45f8-a03d-61d876337a06-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "cinder-quobyte-cb91b8d8-7919-45f8-a03d-61d876337a06" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-quobyte-cb91b8d8-7919-45f8-a03d-61d876337a06" acquired by "delete_volume" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c038e36-d79e-4284-82d4-075d3a83ef1f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:27 devstack quobyte-client[84221]: System call of process 98543 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06" returned: 0 in 0.424s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-cb91b8d8-7919-45f8-a03d-61d876337a06" returned: 0 in 0.101s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-quobyte-cb91b8d8-7919-45f8-a03d-61d876337a06" released by "delete_volume" :: held 0.665s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:27 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Created reservations ['a13e5e2b-4eed-4201-9e13-a436b941e5fe', 'c070cf3f-86b4-4a15-90d4-d923b034690b', '601b77b6-80d7-41c2-874e-f343322955f2', '796ed963-3f8a-477e-9a4d-892a49ab7dfd'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:54:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:54:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:54:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.099s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:28 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:54:28 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Deleted volume successfully.
Sep 27 11:54:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e852110c-7177-4092-96b5-e75946c2d7a7 tempest-AttachVolumeNegativeTest-1614629583 None] Lock "cinder-cb91b8d8-7919-45f8-a03d-61d876337a06-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:37 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Flow 'volume_create_manager' (ee57ed9c-af0d-4047-8ef8-b3c0999df3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213893d9-a0c9-4b5e-8aef-0ebc89f235f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213893d9-a0c9-4b5e-8aef-0ebc89f235f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1350679557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22701f61-093f-4025-92b2-defb680dd07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9a77d72a9478daa8f15a2f55f82d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:54:37Z,use_quota=True,user_id='26d4da7238b645eb8d2bed7ddb385293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef87d725-062b-4edd-959a-014eb5b5ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef87d725-062b-4edd-959a-014eb5b5ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f59bbea-35c9-4cee-b334-9a19bbf81175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f59bbea-35c9-4cee-b334-9a19bbf81175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22701f61-093f-4025-92b2-defb680dd07c', 'volume_name': 'volume-22701f61-093f-4025-92b2-defb680dd07c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547005f3-1977-4d7e-b3e1-d00dbd0e76fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547005f3-1977-4d7e-b3e1-d00dbd0e76fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178b5f2a-a71c-4b91-b5a0-3bdd213e0eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:37 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Volume 22701f61-093f-4025-92b2-defb680dd07c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22701f61-093f-4025-92b2-defb680dd07c', 'volume_size': 1}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1350679557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22701f61-093f-4025-92b2-defb680dd07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f9a77d72a9478daa8f15a2f55f82d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:54:37Z,use_quota=True,user_id='26d4da7238b645eb8d2bed7ddb385293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Creating volume 22701f61-093f-4025-92b2-defb680dd07c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:54:37 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:37 devstack quobyte-client[84221]: System call of process 98551 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:37 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=104, name=volume-22701f61-093f-4025-92b2-defb680dd07c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c 1073741824" returned: 0 in 0.367s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c" returned: 0 in 0.086s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] <== create_volume: return (517ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:54:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.529s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178b5f2a-a71c-4b91-b5a0-3bdd213e0eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22701f61-093f-4025-92b2-defb680dd07c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edb74ba-3b22-4706-8265-84863c0c7458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:38 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Volume volume-22701f61-093f-4025-92b2-defb680dd07c (22701f61-093f-4025-92b2-defb680dd07c): created successfully
Sep 27 11:54:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edb74ba-3b22-4706-8265-84863c0c7458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Flow 'volume_create_manager' (ee57ed9c-af0d-4047-8ef8-b3c0999df3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:54:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-427e43c5-0bfa-461d-bca5-c9fcf07d29c9 req-9b6ba756-ae70-4aa8-a370-cf9451e28611 tempest-VolumesSnapshotsTestJSON-1110524737 None] Created volume successfully.
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.096s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:54:39 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Creating offline snapshot a6c33c85-4e22-48ec-b356-b772a197970b of volume 22701f61-093f-4025-92b2-defb680dd07c {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c77b77e-4936-43e5-bdc5-e13e37ffed6e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c" returned: 0 in 0.392s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:40 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=105, name=volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:54:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b 1G" returned: 0 in 0.260s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): qemu-img rebase -u -b volume-22701f61-093f-4025-92b2-defb680dd07c -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:40 devstack quobyte-client[84221]: System call of process 98562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "qemu-img rebase -u -b volume-22701f61-093f-4025-92b2-defb680dd07c -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b" returned: 0 in 0.179s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:54:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b" returned: 0 in 0.081s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:54:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b" returned: 0 in 0.087s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.info" returned: 0 in 0.099s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:54:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.info" returned: 0 in 0.085s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.554s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:41 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-22fd8623-e4ba-44cf-b34e-18f4ca97b566 req-7035726f-b5c6-461f-a23c-ec19d8d4a4e8 tempest-VolumesSnapshotsTestJSON-1110524737 None] Create snapshot completed successfully
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Acquiring lock "cinder-a6c33c85-4e22-48ec-b356-b772a197970b-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-a6c33c85-4e22-48ec-b356-b772a197970b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:42 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Acquiring lock "cinder-quobyte-22701f61-093f-4025-92b2-defb680dd07c" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-quobyte-22701f61-093f-4025-92b2-defb680dd07c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Acquiring lock "cinder-quobyte-a6c33c85-4e22-48ec-b356-b772a197970b" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-quobyte-a6c33c85-4e22-48ec-b356-b772a197970b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Deleting offline snapshot a6c33c85-4e22-48ec-b356-b772a197970b of volume 22701f61-093f-4025-92b2-defb680dd07c {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] snapshot_file for this snap is: volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a616b060-da38-4434-9d35-a6632d8ecaa6]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b" returned: 0 in 0.401s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22701f61-093f-4025-92b2-defb680dd07c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ccff87-635c-48b6-94a5-7eddf146b066]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c" returned: 0 in 0.409s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:43 devstack quobyte-client[84221]: System call of process 98575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:43 devstack quobyte-client[84221]: System call of process 98575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b" returned: 0 in 0.245s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c.a6c33c85-4e22-48ec-b356-b772a197970b" returned: 0 in 0.095s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-quobyte-a6c33c85-4e22-48ec-b356-b772a197970b" released by "_delete_snapshot" :: held 1.475s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:43 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-quobyte-22701f61-093f-4025-92b2-defb680dd07c" released by "delete_snapshot" :: held 1.506s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:43 devstack cinder-volume[84197]: DEBUG cinder.quota [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Created reservations ['81fdcf80-65ab-464e-ad1b-969078bf8ebe', 'f6768485-848a-4e6a-abf3-e3c9234fd464', '904bf808-5ed0-4666-9971-7da8d031209a', 'bcbd22c3-7680-4323-9c52-656841bc197c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:54:44 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Delete snapshot completed successfully.
Sep 27 11:54:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-1a319abd-ef92-4de7-bdab-ce95d97b212d req-f4c023ee-50bb-4e0f-ac54-bb80e352e19a tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-a6c33c85-4e22-48ec-b356-b772a197970b-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Acquiring lock "cinder-22701f61-093f-4025-92b2-defb680dd07c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-22701f61-093f-4025-92b2-defb680dd07c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:44 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Acquiring lock "cinder-quobyte-22701f61-093f-4025-92b2-defb680dd07c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-quobyte-22701f61-093f-4025-92b2-defb680dd07c" acquired by "delete_volume" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:44 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf95f8de-0cb5-4680-a400-ba2d79240144]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c" returned: 0 in 0.396s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-22701f61-093f-4025-92b2-defb680dd07c" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-quobyte-22701f61-093f-4025-92b2-defb680dd07c" released by "delete_volume" :: held 0.665s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG cinder.quota [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Created reservations ['a1375a8c-e1c4-4e9b-a548-2af947b32862', '5fc2570a-7c3a-4229-a390-e6d304869ec9', '42a39103-61e4-40e9-8202-a32f9b760c31', 'f03ecd6d-e18a-415a-968d-ea31cb00b515'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.224s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:45 devstack cinder-volume[84197]: DEBUG cinder.manager [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:54:45 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Deleted volume successfully.
Sep 27 11:54:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [req-d24a9499-bd53-4646-a0a2-f028d1f40126 req-97cc161c-1c61-4db9-a4f8-506f3743ad13 tempest-VolumesSnapshotsTestJSON-1110524737 None] Lock "cinder-22701f61-093f-4025-92b2-defb680dd07c-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:54:52 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b6c4591a-214a-451e-bcef-2a0a0ffc5e76 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b6c4591a-214a-451e-bcef-2a0a0ffc5e76 tempest-GroupSnapshotsTest-1806063097 None] Group tempest-GroupSnapshotsTest-Group-1658713675: creating
Sep 27 11:54:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b6c4591a-214a-451e-bcef-2a0a0ffc5e76 tempest-GroupSnapshotsTest-1806063097 None] Group tempest-GroupSnapshotsTest-Group-1658713675: created successfully
Sep 27 11:54:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b6c4591a-214a-451e-bcef-2a0a0ffc5e76 tempest-GroupSnapshotsTest-1806063097 None] Create group completed successfully.
Sep 27 11:54:53 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Flow 'volume_create_manager' (9cfb708a-de31-464e-9b86-f5d75291dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fab2096-a151-4148-be8d-5e96b86bc16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fab2096-a151-4148-be8d-5e96b86bc16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113155368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b913aaa5-0ed2-456a-b735-0f3f884bc78e,host='devstack@QuobyteHD#QuobyteHD',id=1d7edb8c-32dd-4c13-b77f-4e90691aeede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54c10f8f15413ba21dabb73a3725e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:54:54Z,use_quota=True,user_id='7b4707659c54499aaa419986885adc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52d35248-d4fb-4edb-be16-dda21c83aeb0),volume_type_id=52d35248-d4fb-4edb-be16-dda21c83aeb0)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2f85d3-48ad-47c7-a309-299bd34485e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2f85d3-48ad-47c7-a309-299bd34485e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65de84d0-970a-4c2b-84c5-242a178cd7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65de84d0-970a-4c2b-84c5-242a178cd7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d7edb8c-32dd-4c13-b77f-4e90691aeede', 'volume_name': 'volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217ee59e-31a8-44eb-9acd-33e8311f70a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217ee59e-31a8-44eb-9acd-33e8311f70a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12c154-2ef9-43b8-aef0-089f43092aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:53 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Volume 1d7edb8c-32dd-4c13-b77f-4e90691aeede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede', 'volume_size': 1}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b913aaa5-0ed2-456a-b735-0f3f884bc78e,created_at=2025-09-27T09:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113155368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b913aaa5-0ed2-456a-b735-0f3f884bc78e,host='devstack@QuobyteHD#QuobyteHD',id=1d7edb8c-32dd-4c13-b77f-4e90691aeede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54c10f8f15413ba21dabb73a3725e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:54:54Z,use_quota=True,user_id='7b4707659c54499aaa419986885adc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52d35248-d4fb-4edb-be16-dda21c83aeb0),volume_type_id=52d35248-d4fb-4edb-be16-dda21c83aeb0)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Creating volume 1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:54:53 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:54:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:53 devstack quobyte-client[84221]: System call of process 98585 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:53 devstack quobyte-client[84221]: System call of process 98585 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:53 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=107, name=volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:54:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede 1073741824" returned: 0 in 0.341s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede" returned: 0 in 0.087s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] <== create_volume: return (496ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:54:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12c154-2ef9-43b8-aef0-089f43092aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb90409-0be8-4915-8736-70d0c08887e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:54:54 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Volume volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede (1d7edb8c-32dd-4c13-b77f-4e90691aeede): created successfully
Sep 27 11:54:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb90409-0be8-4915-8736-70d0c08887e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:54:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Flow 'volume_create_manager' (9cfb708a-de31-464e-9b86-f5d75291dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:54:54 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8c6cc61e-b244-4c73-8d50-375e1831a87b tempest-GroupSnapshotsTest-1806063097 None] Created volume successfully.
Sep 27 11:54:55 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] GroupSnapshot 3cfd5f2e-09c7-4baa-b515-cea83df09a3d: creating.
Sep 27 11:54:55 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Group snapshot 3cfd5f2e-09c7-4baa-b515-cea83df09a3d: creating. {{(pid=84197) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Creating offline snapshot 4ce67952-3bef-442b-8c93-9529820ecd75 of volume 1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade1d08d-f1c3-4279-90e4-c5ace3687d14]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede" returned: 0 in 0.429s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:55 devstack quobyte-client[84221]: System call of process 98592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:55 devstack quobyte-client[84221]: System call of process 98592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:55 devstack quobyte-client[84221]: System call of process 98592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:55 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=108, name=volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 1G" returned: 0 in 0.245s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:55 devstack quobyte-client[84221]: System call of process 98595 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img rebase -u -b volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75" returned: 0 in 0.132s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75" returned: 0 in 0.085s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75" returned: 0 in 0.119s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.info" returned: 0 in 0.098s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.info" returned: 0 in 0.085s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.511s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:56 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9c32278e-e757-44b3-aae0-2f6d6ab61763 tempest-GroupSnapshotsTest-1806063097 None] group_snapshot 3cfd5f2e-09c7-4baa-b515-cea83df09a3d: created successfully
Sep 27 11:54:58 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-4ce67952-3bef-442b-8c93-9529820ecd75-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" by "_create_volume_from_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-4ce67952-3bef-442b-8c93-9529820ecd75-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Creating volume c8fa2a4c-1af0-4b52-a56d-ce29586f8561 from snapshot 4ce67952-3bef-442b-8c93-9529820ecd75 {{(pid=84197) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" by "_copy_volume_from_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] snapshot: 4ce67952-3bef-442b-8c93-9529820ecd75, volume: c8fa2a4c-1af0-4b52-a56d-ce29586f8561,  {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b265fb02-e715-4c1d-b60d-879e6a346b91]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75" returned: 0 in 0.389s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:54:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 27 11:54:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Creating direct copy from snapshot {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 27 11:54:59 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9ac964-beae-4e2a-96c9-896ec3e05127]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:54:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede" returned: 0 in 0.387s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:54:59 devstack cinder-volume[84197]: DEBUG cinder.utils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561 not found in is_blk_device check {{(pid=84197) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 27 11:54:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:54:59 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=110, name=volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" returned: 0 in 5.495s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ff5841-7284-44c9-9d81-fff7d44d5214]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede" returned: 0 in 0.531s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561 {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 11:55:05 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Converted 1024.00 MB image at 185.71 MB/s
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" returned: 0 in 0.084s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" released by "_copy_volume_from_snapshot" :: held 7.251s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-4ce67952-3bef-442b-8c93-9529820ecd75-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" released by "_create_volume_from_snapshot" :: held 7.289s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.353s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:06 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f637124f-c771-4c68-b63a-c09d8790f363 tempest-GroupSnapshotsTest-1806063097 None] Create group from source-snapshot-3cfd5f2e-09c7-4baa-b515-cea83df09a3d completed successfully.
Sep 27 11:55:07 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" acquired by "delete_volume" :: waited 0.021s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:07 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b5330f-fa49-4781-b011-3b8128ba1567]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:08 devstack quobyte-client[84221]: System call of process 98768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" returned: 0 in 0.459s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" returned: 0 in 0.134s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-c8fa2a4c-1af0-4b52-a56d-ce29586f8561" released by "delete_volume" :: held 0.779s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:08 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['ef3991dc-28f0-4e02-8db5-8fff7668549d'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:08 devstack cinder-volume[84197]: WARNING cinder.quota [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1254676836 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1254676836, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:55:08 devstack cinder-volume[84197]: WARNING cinder.quota [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1254676836 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1254676836, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:55:08 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['d080ea65-191a-47e9-afed-cfb234fb0290', '2d682fc5-8c05-40d1-9048-424e3ca64150', '28c2e16e-6421-4801-865c-344d4e335090', 'f4446b74-9b0d-460b-b5ad-ee5a461c599c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:55:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:55:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.083s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:09 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:55:09 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-eb3dc21a-7bc8-47ba-a443-3357ec4c86f9 tempest-GroupSnapshotsTest-1806063097 None] Delete group completed successfully.
Sep 27 11:55:09 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] group_snapshot 3cfd5f2e-09c7-4baa-b515-cea83df09a3d: deleting
Sep 27 11:55:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] group_snapshot 3cfd5f2e-09c7-4baa-b515-cea83df09a3d: deleting {{(pid=84197) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-1d7edb8c-32dd-4c13-b77f-4e90691aeede" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-1d7edb8c-32dd-4c13-b77f-4e90691aeede" acquired by "delete_snapshot" :: waited 0.067s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-4ce67952-3bef-442b-8c93-9529820ecd75" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-4ce67952-3bef-442b-8c93-9529820ecd75" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Deleting offline snapshot 4ce67952-3bef-442b-8c93-9529820ecd75 of volume 1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] snapshot_file for this snap is: volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb73d364-ff2b-4783-a715-4e3ee8abc9d4]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:10 devstack quobyte-client[84221]: System call of process 98813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75" returned: 0 in 0.406s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:55:11 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[14903f40-d96d-4506-b409-5ae5975210fe]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede" returned: 0 in 0.414s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75" returned: 0 in 0.227s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede.4ce67952-3bef-442b-8c93-9529820ecd75" returned: 0 in 0.092s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-4ce67952-3bef-442b-8c93-9529820ecd75" released by "_delete_snapshot" :: held 1.472s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-1d7edb8c-32dd-4c13-b77f-4e90691aeede" released by "delete_snapshot" :: held 1.499s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:12 devstack cinder-volume[84197]: WARNING cinder.quota [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1254676836 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1254676836, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:55:12 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['4a23b792-3732-4955-89ca-f00796e964c0', '1bef7f4c-4813-41f1-a180-4587ba2b01eb', '209472a2-eaeb-4587-88e7-ef91bf67b5fe', 'ff9dbc9a-e39a-401a-a9ad-13a84d2363ee'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-eb7586a3-d7b8-455b-a7c4-740a085f0fe6 tempest-GroupSnapshotsTest-1806063097 None] group_snapshot 3cfd5f2e-09c7-4baa-b515-cea83df09a3d: deleted successfully
Sep 27 11:55:13 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-1d7edb8c-32dd-4c13-b77f-4e90691aeede" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-1d7edb8c-32dd-4c13-b77f-4e90691aeede" acquired by "delete_volume" :: waited 0.030s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:13 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6348e9-6217-4798-982b-90a728745a94]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:14 devstack quobyte-client[84221]: System call of process 98908 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:14 devstack quobyte-client[84221]: System call of process 98908 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede" returned: 0 in 0.395s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1d7edb8c-32dd-4c13-b77f-4e90691aeede" returned: 0 in 0.144s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-1d7edb8c-32dd-4c13-b77f-4e90691aeede" released by "delete_volume" :: held 0.692s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['6310870e-af06-4b1e-b867-c1820ffe0c28'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:14 devstack cinder-volume[84197]: WARNING cinder.db.sqlalchemy.api [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1254676836']
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['0ed01592-6c58-46ad-bb89-5db2f5c6e898', '4994e636-4b8f-4ce9-84f9-959c163c267c', '0ffb5b5f-9fdd-49ba-ad40-0c6c52c60c81', 'b12d96f4-5efd-4a76-8990-4608ebfc50e4'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.083s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:15 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:55:15 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b6abdf89-f5fe-43fe-9f73-f5e9b831981a tempest-GroupSnapshotsTest-1806063097 None] Delete group completed successfully.
Sep 27 11:55:16 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e5d69098-2934-495e-ada2-ec9870b53b14 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:16 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e5d69098-2934-495e-ada2-ec9870b53b14 tempest-GroupSnapshotsTest-1806063097 None] Group tempest-GroupSnapshotsTest-Group-1251982115: creating
Sep 27 11:55:16 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e5d69098-2934-495e-ada2-ec9870b53b14 tempest-GroupSnapshotsTest-1806063097 None] Group tempest-GroupSnapshotsTest-Group-1251982115: created successfully
Sep 27 11:55:16 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e5d69098-2934-495e-ada2-ec9870b53b14 tempest-GroupSnapshotsTest-1806063097 None] Create group completed successfully.
Sep 27 11:55:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Flow 'volume_create_manager' (99d1f1f5-1825-4f65-a908-40618d9e97f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ca665-0812-4ffe-ba39-7c17a0b07021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ca665-0812-4ffe-ba39-7c17a0b07021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907153090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=38cd2e1e-0620-4ae1-96d7-98f0e4cbfa9b,host='devstack@QuobyteHD#QuobyteHD',id=8175d9db-72b8-49c6-b212-3be7b7da9bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54c10f8f15413ba21dabb73a3725e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:55:18Z,use_quota=True,user_id='7b4707659c54499aaa419986885adc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73d5e46d-b2a2-4900-9415-b5b3591e300d),volume_type_id=73d5e46d-b2a2-4900-9415-b5b3591e300d)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0c54d6-053a-4c71-be62-47d19da90ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0c54d6-053a-4c71-be62-47d19da90ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5100cf-eeab-4c33-a97a-a1d9d1a5e363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5100cf-eeab-4c33-a97a-a1d9d1a5e363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8175d9db-72b8-49c6-b212-3be7b7da9bb5', 'volume_name': 'volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c51b569-6408-4315-8f65-1b75e65cc0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c51b569-6408-4315-8f65-1b75e65cc0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f4e515-2abb-44fd-9644-9cbd0e81d17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:17 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Volume 8175d9db-72b8-49c6-b212-3be7b7da9bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5', 'volume_size': 1}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=38cd2e1e-0620-4ae1-96d7-98f0e4cbfa9b,created_at=2025-09-27T09:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907153090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=38cd2e1e-0620-4ae1-96d7-98f0e4cbfa9b,host='devstack@QuobyteHD#QuobyteHD',id=8175d9db-72b8-49c6-b212-3be7b7da9bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54c10f8f15413ba21dabb73a3725e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:55:18Z,use_quota=True,user_id='7b4707659c54499aaa419986885adc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73d5e46d-b2a2-4900-9415-b5b3591e300d),volume_type_id=73d5e46d-b2a2-4900-9415-b5b3591e300d)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Creating volume 8175d9db-72b8-49c6-b212-3be7b7da9bb5 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:55:17 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:55:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:18 devstack quobyte-client[84221]: System call of process 98914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:18 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=111, name=volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:55:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 1073741824" returned: 0 in 0.348s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5" returned: 0 in 0.091s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] <== create_volume: return (509ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:55:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.521s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f4e515-2abb-44fd-9644-9cbd0e81d17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1845f7a-12cd-48c5-94de-61a3780b59d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:18 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Volume volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 (8175d9db-72b8-49c6-b212-3be7b7da9bb5): created successfully
Sep 27 11:55:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1845f7a-12cd-48c5-94de-61a3780b59d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Flow 'volume_create_manager' (99d1f1f5-1825-4f65-a908-40618d9e97f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:55:18 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1b88004e-8182-4aeb-bf9f-047ae7b198af tempest-GroupSnapshotsTest-1806063097 None] Created volume successfully.
Sep 27 11:55:19 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Flow 'volume_create_manager' (59172ff1-13e6-4eed-8136-8b1b1a20337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5e934c-b09e-460f-8cd5-e821a057b57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5e934c-b09e-460f-8cd5-e821a057b57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-927026608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=38cd2e1e-0620-4ae1-96d7-98f0e4cbfa9b,host='devstack@QuobyteHD#QuobyteHD',id=b914388e-299b-4f60-aff5-1bd403b65048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54c10f8f15413ba21dabb73a3725e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:55:19Z,use_quota=True,user_id='7b4707659c54499aaa419986885adc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73d5e46d-b2a2-4900-9415-b5b3591e300d),volume_type_id=73d5e46d-b2a2-4900-9415-b5b3591e300d)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100fb47e-01a1-4220-83c0-64cc4399229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100fb47e-01a1-4220-83c0-64cc4399229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4e55e2-0ece-42b9-bc36-fe44c62d734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4e55e2-0ece-42b9-bc36-fe44c62d734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b914388e-299b-4f60-aff5-1bd403b65048', 'volume_name': 'volume-b914388e-299b-4f60-aff5-1bd403b65048', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e5285f-d835-4cfb-aa3a-252257446dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e5285f-d835-4cfb-aa3a-252257446dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12d235c-1567-4564-aa2e-3858b9f3a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:19 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Volume b914388e-299b-4f60-aff5-1bd403b65048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b914388e-299b-4f60-aff5-1bd403b65048', 'volume_size': 1}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=38cd2e1e-0620-4ae1-96d7-98f0e4cbfa9b,created_at=2025-09-27T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-927026608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=38cd2e1e-0620-4ae1-96d7-98f0e4cbfa9b,host='devstack@QuobyteHD#QuobyteHD',id=b914388e-299b-4f60-aff5-1bd403b65048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54c10f8f15413ba21dabb73a3725e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:55:19Z,use_quota=True,user_id='7b4707659c54499aaa419986885adc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73d5e46d-b2a2-4900-9415-b5b3591e300d),volume_type_id=73d5e46d-b2a2-4900-9415-b5b3591e300d)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Creating volume b914388e-299b-4f60-aff5-1bd403b65048 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:55:19 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:19 devstack quobyte-client[84221]: System call of process 98918 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:19 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=112, name=volume-b914388e-299b-4f60-aff5-1bd403b65048, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 1073741824" returned: 0 in 0.342s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048" returned: 0 in 0.084s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] <== create_volume: return (496ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:55:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12d235c-1567-4564-aa2e-3858b9f3a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b914388e-299b-4f60-aff5-1bd403b65048', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601d573c-fbdd-409a-9daf-b6f9d44cf846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:20 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Volume volume-b914388e-299b-4f60-aff5-1bd403b65048 (b914388e-299b-4f60-aff5-1bd403b65048): created successfully
Sep 27 11:55:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601d573c-fbdd-409a-9daf-b6f9d44cf846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Flow 'volume_create_manager' (59172ff1-13e6-4eed-8136-8b1b1a20337a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:55:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c2162006-550e-4c2e-a86f-2f0b07945ffd tempest-GroupSnapshotsTest-1806063097 None] Created volume successfully.
Sep 27 11:55:20 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9354a367-ac3e-4646-b0c9-cd6cb05d02ac tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9354a367-ac3e-4646-b0c9-cd6cb05d02ac tempest-GroupSnapshotsTest-1806063097 None] Update group completed successfully.
Sep 27 11:55:21 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b63947a9-cd1e-4cf4-95ee-2713eb202aaa tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:21 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b63947a9-cd1e-4cf4-95ee-2713eb202aaa tempest-GroupSnapshotsTest-1806063097 None] Update group completed successfully.
Sep 27 11:55:22 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=86,cinder:SELECT=70,cinder:INSERT=20,cinder:DELETE=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:55:22 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=76,cinder:INSERT=14,cinder:UPDATE=75,cinder:DELETE=3 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:55:22 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-34d0d2fe-5bcc-4829-afc1-9d56bfb8991a tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:22 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-34d0d2fe-5bcc-4829-afc1-9d56bfb8991a tempest-GroupSnapshotsTest-1806063097 None] Update group completed successfully.
Sep 27 11:55:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-fa6d66f2-1622-47cb-ad98-ed99c3628c2c tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:24 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-fa6d66f2-1622-47cb-ad98-ed99c3628c2c tempest-GroupSnapshotsTest-1806063097 None] Update group completed successfully.
Sep 27 11:55:25 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] GroupSnapshot adb6bec8-cd4a-4c44-b9a2-178a6ca3b08d: creating.
Sep 27 11:55:25 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Group snapshot adb6bec8-cd4a-4c44-b9a2-178a6ca3b08d: creating. {{(pid=84197) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 27 11:55:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Creating offline snapshot 8be892c6-e38e-4c3a-88df-95aef860dcb1 of volume b914388e-299b-4f60-aff5-1bd403b65048 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:55:25 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1e08ed-0727-4fb0-854f-24fce905ab3a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048" returned: 0 in 0.423s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:26 devstack quobyte-client[84221]: System call of process 98928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:26 devstack quobyte-client[84221]: System call of process 98928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:26 devstack quobyte-client[84221]: System call of process 98928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:26 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=113, name=volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 1G" returned: 0 in 0.272s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b914388e-299b-4f60-aff5-1bd403b65048 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img rebase -u -b volume-b914388e-299b-4f60-aff5-1bd403b65048 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1" returned: 0 in 0.163s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1" returned: 0 in 0.093s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1" returned: 0 in 0.117s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.info" returned: 0 in 0.098s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:55:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.info" returned: 0 in 0.087s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.562s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Creating offline snapshot bff85d50-df5a-426d-a6dc-468bdf84fcf4 of volume 8175d9db-72b8-49c6-b212-3be7b7da9bb5 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:55:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e301f0-963b-47ba-8ba2-fe24a60cb740]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:27 devstack quobyte-client[84221]: System call of process 98939 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5" returned: 0 in 0.422s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:28 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=115, name=volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 1G" returned: 0 in 0.275s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img rebase -u -b volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4" returned: 0 in 0.142s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4" returned: 0 in 0.091s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4" returned: 0 in 0.092s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.info" returned: 0 in 0.124s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.info" returned: 0 in 0.091s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.790s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:29 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-6efbd275-b230-4ad2-91d7-7062a0f27c85 tempest-GroupSnapshotsTest-1806063097 None] group_snapshot adb6bec8-cd4a-4c44-b9a2-178a6ca3b08d: created successfully
Sep 27 11:55:29 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] group_snapshot adb6bec8-cd4a-4c44-b9a2-178a6ca3b08d: deleting
Sep 27 11:55:29 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:29 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] group_snapshot adb6bec8-cd4a-4c44-b9a2-178a6ca3b08d: deleting {{(pid=84197) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-b914388e-299b-4f60-aff5-1bd403b65048" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-b914388e-299b-4f60-aff5-1bd403b65048" acquired by "delete_snapshot" :: waited 0.061s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-8be892c6-e38e-4c3a-88df-95aef860dcb1" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-8be892c6-e38e-4c3a-88df-95aef860dcb1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Deleting offline snapshot 8be892c6-e38e-4c3a-88df-95aef860dcb1 of volume b914388e-299b-4f60-aff5-1bd403b65048 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] snapshot_file for this snap is: volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e8761f-f2cd-4210-a82e-e6e73c71c5ff]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1" returned: 0 in 0.430s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b914388e-299b-4f60-aff5-1bd403b65048(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[49039347-4c09-429c-a9e3-94332f4fedc3]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048" returned: 0 in 0.420s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:31 devstack quobyte-client[84221]: System call of process 98958 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:31 devstack quobyte-client[84221]: System call of process 98958 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:31 devstack quobyte-client[84221]: System call of process 98958 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1" returned: 0 in 0.248s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048.8be892c6-e38e-4c3a-88df-95aef860dcb1" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-8be892c6-e38e-4c3a-88df-95aef860dcb1" released by "_delete_snapshot" :: held 1.552s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-b914388e-299b-4f60-aff5-1bd403b65048" released by "delete_snapshot" :: held 1.585s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-8175d9db-72b8-49c6-b212-3be7b7da9bb5" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-8175d9db-72b8-49c6-b212-3be7b7da9bb5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-bff85d50-df5a-426d-a6dc-468bdf84fcf4" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-bff85d50-df5a-426d-a6dc-468bdf84fcf4" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Deleting offline snapshot bff85d50-df5a-426d-a6dc-468bdf84fcf4 of volume 8175d9db-72b8-49c6-b212-3be7b7da9bb5 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] snapshot_file for this snap is: volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[41711667-e275-41c2-a07a-9e90fbeb09c4]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4" returned: 0 in 0.392s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:55:32 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[525fa03b-c4f3-4104-9eb1-a3392667dd81]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5" returned: 0 in 0.394s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:33 devstack quobyte-client[84221]: System call of process 98968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:33 devstack quobyte-client[84221]: System call of process 98968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:33 devstack quobyte-client[84221]: System call of process 98968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:33 devstack quobyte-client[84221]: System call of process 98968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4" returned: 0 in 0.215s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5.bff85d50-df5a-426d-a6dc-468bdf84fcf4" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-bff85d50-df5a-426d-a6dc-468bdf84fcf4" released by "_delete_snapshot" :: held 1.423s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:33 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-8175d9db-72b8-49c6-b212-3be7b7da9bb5" released by "delete_snapshot" :: held 1.446s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:33 devstack cinder-volume[84197]: WARNING cinder.quota [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1950499626 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1950499626, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:55:33 devstack cinder-volume[84197]: WARNING cinder.quota [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1950499626 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1950499626, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:55:33 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['af70ebd3-8388-499d-95bc-5016bf3aefde', 'af7eeef6-07b6-4d20-98d1-e70f5e46d7f2', '0fee1bd2-40a9-4bf6-8c0b-9ce7c71d9347', '6a4275a8-652c-4068-b00e-c414c8a0ccd9'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:33 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['0589b471-f057-411f-8889-13b0780dda2b', 'd159e0df-5ad6-47f3-ba21-59d52c62293d', '84411403-b671-46cc-9960-1484bd7d6854', '27fab614-f56c-4756-a02e-615e61e2726d'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:34 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7fa850f8-dcc8-4ef7-a80c-9ffd01189795 tempest-GroupSnapshotsTest-1806063097 None] group_snapshot adb6bec8-cd4a-4c44-b9a2-178a6ca3b08d: deleted successfully
Sep 27 11:55:34 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-8175d9db-72b8-49c6-b212-3be7b7da9bb5" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-8175d9db-72b8-49c6-b212-3be7b7da9bb5" acquired by "delete_volume" :: waited 0.023s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:34 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68d0d11-3c7a-412e-8145-0ba4c26d884e]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5" returned: 0 in 0.407s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8175d9db-72b8-49c6-b212-3be7b7da9bb5" returned: 0 in 0.123s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-8175d9db-72b8-49c6-b212-3be7b7da9bb5" released by "delete_volume" :: held 0.725s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-b914388e-299b-4f60-aff5-1bd403b65048" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:35 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-b914388e-299b-4f60-aff5-1bd403b65048" acquired by "delete_volume" :: waited 0.027s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:35 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96162fb-f6df-4c47-9e22-1ff99ad657cf]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048" returned: 0 in 0.413s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b914388e-299b-4f60-aff5-1bd403b65048" returned: 0 in 0.097s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:36 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-b914388e-299b-4f60-aff5-1bd403b65048" released by "delete_volume" :: held 0.701s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:36 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['37fa7cf3-dd00-4b0c-a9e9-d04d49ed5bf8'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:36 devstack cinder-volume[84197]: WARNING cinder.quota [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1950499626 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1950499626, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:55:36 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['7394f2eb-0519-4c03-8ea6-165e1a800af2', '2302319e-7f3f-4bd4-a421-98dd6b9ca3c0', 'fd005fbc-69de-4ec4-91d9-03a34c40aea9', '352c7a84-a9af-4609-84a7-c857df8666d2'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:36 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['5ebd74e1-1857-4760-b963-d522ff1ce30c', 'c720b358-f429-4aad-a3a4-3de7a2577a65', '440de44d-1ebf-4367-a154-f32c4016fb61', '0d026c0d-cdb1-41c1-9327-580d51f21b80'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:55:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:55:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:37 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:55:37 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-3af5159f-6edb-457d-8302-af72f04b5e64 tempest-GroupSnapshotsTest-1806063097 None] Delete group completed successfully.
Sep 27 11:55:38 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-16a09872-2784-44e3-a2fd-e92c5e38c5fd tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-16a09872-2784-44e3-a2fd-e92c5e38c5fd tempest-GroupSnapshotsTest-1806063097 None] Group tempest-GroupSnapshotsTest-Group-1513603847: creating
Sep 27 11:55:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-16a09872-2784-44e3-a2fd-e92c5e38c5fd tempest-GroupSnapshotsTest-1806063097 None] Group tempest-GroupSnapshotsTest-Group-1513603847: created successfully
Sep 27 11:55:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-16a09872-2784-44e3-a2fd-e92c5e38c5fd tempest-GroupSnapshotsTest-1806063097 None] Create group completed successfully.
Sep 27 11:55:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:55:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:55:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:55:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.115s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:55:40 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Flow 'volume_create_manager' (275371c4-ad75-4770-ac76-859444f55d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12b97b1-0f8f-4b59-9083-463044d9245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12b97b1-0f8f-4b59-9083-463044d9245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1487875308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e34987f-306f-4e6e-bdfe-d35fc24ddf76,host='devstack@QuobyteHD#QuobyteHD',id=dab4b1d6-822e-44f7-9d43-42c12d4e541e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54c10f8f15413ba21dabb73a3725e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:55:40Z,use_quota=True,user_id='7b4707659c54499aaa419986885adc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dadadf9-934d-4457-9583-b02982cc08a5),volume_type_id=0dadadf9-934d-4457-9583-b02982cc08a5)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac34ae51-2334-45e7-9546-8be2e38bba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac34ae51-2334-45e7-9546-8be2e38bba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a494041f-15f0-41c9-99a3-a7686ca11b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a494041f-15f0-41c9-99a3-a7686ca11b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab4b1d6-822e-44f7-9d43-42c12d4e541e', 'volume_name': 'volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e66270-c838-4dd5-860d-156fdb6245e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e66270-c838-4dd5-860d-156fdb6245e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a2d1ac-cfa6-4145-995a-d623d379248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:40 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Volume dab4b1d6-822e-44f7-9d43-42c12d4e541e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e', 'volume_size': 1}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4e34987f-306f-4e6e-bdfe-d35fc24ddf76,created_at=2025-09-27T09:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1487875308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e34987f-306f-4e6e-bdfe-d35fc24ddf76,host='devstack@QuobyteHD#QuobyteHD',id=dab4b1d6-822e-44f7-9d43-42c12d4e541e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54c10f8f15413ba21dabb73a3725e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:55:40Z,use_quota=True,user_id='7b4707659c54499aaa419986885adc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dadadf9-934d-4457-9583-b02982cc08a5),volume_type_id=0dadadf9-934d-4457-9583-b02982cc08a5)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Creating volume dab4b1d6-822e-44f7-9d43-42c12d4e541e {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:55:40 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:40 devstack quobyte-client[84221]: System call of process 98983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:40 devstack quobyte-client[84221]: System call of process 98983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:40 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=117, name=volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e 1073741824" returned: 0 in 0.365s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e" returned: 0 in 0.092s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] <== create_volume: return (530ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:55:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.542s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a2d1ac-cfa6-4145-995a-d623d379248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48159e83-a400-4c5c-a945-af134971a1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:55:41 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Volume volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e (dab4b1d6-822e-44f7-9d43-42c12d4e541e): created successfully
Sep 27 11:55:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48159e83-a400-4c5c-a945-af134971a1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:55:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Flow 'volume_create_manager' (275371c4-ad75-4770-ac76-859444f55d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:55:41 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f72ab89b-1714-454e-8332-300ea6e9b118 tempest-GroupSnapshotsTest-1806063097 None] Created volume successfully.
Sep 27 11:55:42 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] GroupSnapshot a07630b6-2995-498f-8480-4e802f122600: creating.
Sep 27 11:55:42 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Group snapshot a07630b6-2995-498f-8480-4e802f122600: creating. {{(pid=84197) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 27 11:55:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Creating offline snapshot 8131161b-20e9-4eb4-96fc-dabfdc0dad46 of volume dab4b1d6-822e-44f7-9d43-42c12d4e541e {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:55:42 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[7641c546-465d-447b-a017-c23e0ee46aa7]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e" returned: 0 in 0.417s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:43 devstack quobyte-client[84221]: System call of process 98990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:43 devstack quobyte-client[84221]: System call of process 98990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:43 devstack quobyte-client[84221]: System call of process 98990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:43 devstack quobyte-client[84221]: System call of process 98990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:43 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=118, name=volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:55:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 1G" returned: 0 in 0.322s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img rebase -u -b volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img rebase -u -b volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46" returned: 0 in 0.176s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:55:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46" returned: 0 in 0.113s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46" returned: 0 in 0.103s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.info" returned: 0 in 0.097s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.info" returned: 0 in 0.091s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.694s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:44 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e96d9482-652f-4785-9735-204e342d1b7f tempest-GroupSnapshotsTest-1806063097 None] group_snapshot a07630b6-2995-498f-8480-4e802f122600: created successfully
Sep 27 11:55:46 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] group_snapshot a07630b6-2995-498f-8480-4e802f122600: deleting
Sep 27 11:55:46 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] group_snapshot a07630b6-2995-498f-8480-4e802f122600: deleting {{(pid=84197) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-dab4b1d6-822e-44f7-9d43-42c12d4e541e" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-dab4b1d6-822e-44f7-9d43-42c12d4e541e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-8131161b-20e9-4eb4-96fc-dabfdc0dad46" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-8131161b-20e9-4eb4-96fc-dabfdc0dad46" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Deleting offline snapshot 8131161b-20e9-4eb4-96fc-dabfdc0dad46 of volume dab4b1d6-822e-44f7-9d43-42c12d4e541e {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] snapshot_file for this snap is: volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dcc539-c06d-4a97-85ae-398338e16c36]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46" returned: 0 in 0.427s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[869cea8e-db18-4992-ad62-2c0ecf94977f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e" returned: 0 in 0.418s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:47 devstack quobyte-client[84221]: System call of process 99007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:55:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46" returned: 0 in 0.311s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e.8131161b-20e9-4eb4-96fc-dabfdc0dad46" returned: 0 in 0.091s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-8131161b-20e9-4eb4-96fc-dabfdc0dad46" released by "_delete_snapshot" :: held 1.581s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-dab4b1d6-822e-44f7-9d43-42c12d4e541e" released by "delete_snapshot" :: held 1.607s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:48 devstack cinder-volume[84197]: WARNING cinder.quota [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-594956111 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-594956111, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:55:48 devstack cinder-volume[84197]: WARNING cinder.quota [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-594956111 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-594956111, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:55:48 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['15a43017-d097-4c02-a654-fcda68f79674', '478756eb-523e-4eee-96bc-48cc4ee480f2', 'efe81a7b-cb55-4268-aa26-04bf67892ec7', '707dcd28-0755-4fc1-88f8-7aea718013a0'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:48 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-65814dfb-dbd1-4b90-860a-0745c3bac81e tempest-GroupSnapshotsTest-1806063097 None] group_snapshot a07630b6-2995-498f-8480-4e802f122600: deleted successfully
Sep 27 11:55:48 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "cinder-quobyte-dab4b1d6-822e-44f7-9d43-42c12d4e541e" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:55:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-dab4b1d6-822e-44f7-9d43-42c12d4e541e" acquired by "delete_volume" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:55:48 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[c162981e-2bc2-4622-8f29-4292745eaa0f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:55:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e" returned: 0 in 0.460s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-dab4b1d6-822e-44f7-9d43-42c12d4e541e" returned: 0 in 0.107s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Lock "cinder-quobyte-dab4b1d6-822e-44f7-9d43-42c12d4e541e" released by "delete_volume" :: held 0.741s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:55:49 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['5a4b45e0-e179-4087-b062-9e8e6b1b130c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:49 devstack cinder-volume[84197]: WARNING cinder.quota [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-594956111 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-594956111, it is now deprecated. Please use the default quota class for default quota.
Sep 27 11:55:49 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Created reservations ['9a5dc73d-d18b-4727-abc5-4285aeb8e553', '3835130d-3e9f-4d46-afd8-bda4217a42e2', '41aed338-a14a-45d6-ad42-21edb18343e8', '30ba771e-8838-4df1-aa8e-aa9ca83d57f8'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:55:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:55:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.095s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:50 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:55:50 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b67b4555-5b27-415c-b717-d47ed3e47783 tempest-GroupSnapshotsTest-1806063097 None] Delete group completed successfully.
Sep 27 11:55:56 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9c8e58a1-2f60-4bad-a050-4b7545b0c255 tempest-GroupsV320Test-1941228226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:56 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9c8e58a1-2f60-4bad-a050-4b7545b0c255 tempest-GroupsV320Test-1941228226 None] Group tempest-GroupsV320Test-Group-750788656: creating
Sep 27 11:55:56 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9c8e58a1-2f60-4bad-a050-4b7545b0c255 tempest-GroupsV320Test-1941228226 None] Group tempest-GroupsV320Test-Group-750788656: created successfully
Sep 27 11:55:56 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9c8e58a1-2f60-4bad-a050-4b7545b0c255 tempest-GroupsV320Test-1941228226 None] Create group completed successfully.
Sep 27 11:55:58 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:55:58 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Created reservations ['8c16c858-0c45-47a0-8653-a4c323d2b750'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:55:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:55:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:55:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:55:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:55:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:55:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:55:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.126s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:55:58 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:55:58 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8be16716-bcf5-49d4-871d-a6a65de8489a tempest-GroupsV320Test-1941228226 None] Delete group completed successfully.
Sep 27 11:56:08 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=62,cinder:UPDATE=65,cinder:INSERT=12,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:56:08 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=69,cinder:UPDATE=57,cinder:INSERT=15 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:56:20 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Flow 'volume_create_manager' (861f94e8-b4dc-4f36-8190-557ab81c660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c48ae01-1af9-4f07-8c16-41855fee8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c48ae01-1af9-4f07-8c16-41855fee8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1055301819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f229e16a-c72e-4925-b906-47f4f989e6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4040ca01f35c41f08a8e7041d7aa2aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:20Z,use_quota=True,user_id='d700da457e894eb0bee72fccfd89efee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10964ff8-98ef-45d0-8db7-a837a4053edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10964ff8-98ef-45d0-8db7-a837a4053edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0faffe46-1629-4524-86a2-bf5cd2661959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0faffe46-1629-4524-86a2-bf5cd2661959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f229e16a-c72e-4925-b906-47f4f989e6d4', 'volume_name': 'volume-f229e16a-c72e-4925-b906-47f4f989e6d4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec9216c-2f7e-45d7-9e7f-1926f028b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec9216c-2f7e-45d7-9e7f-1926f028b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff74784-ae69-4e75-9c69-c32cdcdb8964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:20 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Volume f229e16a-c72e-4925-b906-47f4f989e6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f229e16a-c72e-4925-b906-47f4f989e6d4', 'volume_size': 1}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1055301819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f229e16a-c72e-4925-b906-47f4f989e6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4040ca01f35c41f08a8e7041d7aa2aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:20Z,use_quota=True,user_id='d700da457e894eb0bee72fccfd89efee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Creating volume f229e16a-c72e-4925-b906-47f4f989e6d4 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:56:20 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:20 devstack quobyte-client[84221]: System call of process 99062 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:20 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=120, name=volume-f229e16a-c72e-4925-b906-47f4f989e6d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 1073741824" returned: 0 in 0.369s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4" returned: 0 in 0.085s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] <== create_volume: return (524ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:56:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.536s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff74784-ae69-4e75-9c69-c32cdcdb8964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f229e16a-c72e-4925-b906-47f4f989e6d4', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0b2805-803d-45e7-88ee-12d088c0d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:23 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Volume volume-f229e16a-c72e-4925-b906-47f4f989e6d4 (f229e16a-c72e-4925-b906-47f4f989e6d4): created successfully
Sep 27 11:56:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0b2805-803d-45e7-88ee-12d088c0d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Flow 'volume_create_manager' (861f94e8-b4dc-4f36-8190-557ab81c660b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e12a8915-33ef-4795-8d0b-a4e6962f9fe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Created volume successfully.
Sep 27 11:56:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Creating offline snapshot b29e602a-4f38-4c5e-bf4a-688de531ec4e of volume f229e16a-c72e-4925-b906-47f4f989e6d4 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:56:24 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[977aed75-bd87-48fd-9e12-721052d3e7f8]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:56:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4" returned: 0 in 0.423s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:25 devstack quobyte-client[84221]: System call of process 99069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:25 devstack quobyte-client[84221]: System call of process 99069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:25 devstack quobyte-client[84221]: System call of process 99069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:25 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=121, name=volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e 1G" returned: 0 in 0.281s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f229e16a-c72e-4925-b906-47f4f989e6d4 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:25 devstack quobyte-client[84221]: System call of process 99072 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "qemu-img rebase -u -b volume-f229e16a-c72e-4925-b906-47f4f989e6d4 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e" returned: 0 in 0.150s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.info" returned: 0 in 0.094s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:56:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.info" returned: 0 in 0.091s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.558s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:26 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-aff159b7-8b1d-48e5-8420-ad961c657e80 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Create snapshot completed successfully
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Acquiring lock "cinder-b29e602a-4f38-4c5e-bf4a-688de531ec4e-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-b29e602a-4f38-4c5e-bf4a-688de531ec4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Acquiring lock "cinder-quobyte-f229e16a-c72e-4925-b906-47f4f989e6d4" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-quobyte-f229e16a-c72e-4925-b906-47f4f989e6d4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Acquiring lock "cinder-quobyte-b29e602a-4f38-4c5e-bf4a-688de531ec4e" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-quobyte-b29e602a-4f38-4c5e-bf4a-688de531ec4e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Deleting offline snapshot b29e602a-4f38-4c5e-bf4a-688de531ec4e of volume f229e16a-c72e-4925-b906-47f4f989e6d4 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] snapshot_file for this snap is: volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[46895f46-fe30-4d6c-9ff0-e446cc45365d]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:27 devstack quobyte-client[84221]: System call of process 99080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:27 devstack quobyte-client[84221]: System call of process 99080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:27 devstack quobyte-client[84221]: System call of process 99080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e" returned: 0 in 0.431s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f229e16a-c72e-4925-b906-47f4f989e6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9398e5b8-cedb-43c8-a1ea-61e3a912a0df]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:56:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4" returned: 0 in 0.420s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e" returned: 0 in 0.247s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4.b29e602a-4f38-4c5e-bf4a-688de531ec4e" returned: 0 in 0.090s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-quobyte-b29e602a-4f38-4c5e-bf4a-688de531ec4e" released by "_delete_snapshot" :: held 1.520s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-quobyte-f229e16a-c72e-4925-b906-47f4f989e6d4" released by "delete_snapshot" :: held 1.548s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:29 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Created reservations ['e5576ce2-74ad-4f88-8939-3e6edb89cbcd', 'd3d7646a-44a9-44d1-ac61-3956e40d0518', '768d7bc7-583f-4cce-bd0a-12abb5cac350', '40dc6aae-c9f8-4c29-851f-63ad460d02f0'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:56:29 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Delete snapshot completed successfully.
Sep 27 11:56:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e90783f5-8a62-49fd-b91a-7271378c2d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-b29e602a-4f38-4c5e-bf4a-688de531ec4e-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Acquiring lock "cinder-f229e16a-c72e-4925-b906-47f4f989e6d4-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-f229e16a-c72e-4925-b906-47f4f989e6d4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Acquiring lock "cinder-quobyte-f229e16a-c72e-4925-b906-47f4f989e6d4" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-quobyte-f229e16a-c72e-4925-b906-47f4f989e6d4" acquired by "delete_volume" :: waited 0.018s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:30 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3e6a98-f59e-491b-87e8-b9c4e4bdcf4d]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:56:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4" returned: 0 in 0.409s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f229e16a-c72e-4925-b906-47f4f989e6d4" returned: 0 in 0.094s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-quobyte-f229e16a-c72e-4925-b906-47f4f989e6d4" released by "delete_volume" :: held 0.678s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Created reservations ['3324e448-6cea-4795-ab52-f3cb43663e1a', 'f770f764-1cbd-4dd3-9323-cd6e27abe203', '6a04a283-52ee-4259-a8b5-b1c0441e80d1', 'bfa341bd-e428-45e5-a5db-ff6c9d2f956e'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.081s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:31 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:56:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Deleted volume successfully.
Sep 27 11:56:32 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e17c748b-baf4-4925-aa07-58ed05d3a6e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1156088620 None] Lock "cinder-f229e16a-c72e-4925-b906-47f4f989e6d4-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:56:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.109s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:56:41 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:56:41 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=16,cinder:UPDATE=19,cinder:DELETE=3,cinder:INSERT=4 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:56:42 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Flow 'volume_create_manager' (907cfca7-44f7-4bbd-8948-7e93b3f60566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf7c9da-75b7-4849-b39c-ab720d639fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf7c9da-75b7-4849-b39c-ab720d639fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-820632453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f925a4b-2fc9-4c7f-be0e-60bed2597c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a75060d43e4a89b89c7bfda5e561d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:42Z,use_quota=True,user_id='a13fd922c6e64cfa88c6078d42b15ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e12e354-1449-4095-9701-598af5385052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e12e354-1449-4095-9701-598af5385052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f97aa4f-d545-4a50-96ca-f64a7861981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f97aa4f-d545-4a50-96ca-f64a7861981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f925a4b-2fc9-4c7f-be0e-60bed2597c50', 'volume_name': 'volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5b1f2e-dcc1-4f23-a308-d05609a1ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5b1f2e-dcc1-4f23-a308-d05609a1ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da917348-973c-4d76-8666-8c3c7c6a2b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:42 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Volume 1f925a4b-2fc9-4c7f-be0e-60bed2597c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50', 'volume_size': 1}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-820632453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f925a4b-2fc9-4c7f-be0e-60bed2597c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a75060d43e4a89b89c7bfda5e561d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:42Z,use_quota=True,user_id='a13fd922c6e64cfa88c6078d42b15ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Creating volume 1f925a4b-2fc9-4c7f-be0e-60bed2597c50 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:56:42 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:42 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=123, name=volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50 1073741824" returned: 0 in 0.347s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50" returned: 0 in 0.086s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] <== create_volume: return (503ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:56:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.517s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da917348-973c-4d76-8666-8c3c7c6a2b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3381801c-4899-446b-819d-e72873af88ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:43 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Volume volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50 (1f925a4b-2fc9-4c7f-be0e-60bed2597c50): created successfully
Sep 27 11:56:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3381801c-4899-446b-819d-e72873af88ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Flow 'volume_create_manager' (907cfca7-44f7-4bbd-8948-7e93b3f60566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:43 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-3e7dbb61-c819-4778-a5c1-5ea774a3a292 tempest-VolumesListAdminTestJSON-509769921 None] Created volume successfully.
Sep 27 11:56:44 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Flow 'volume_create_manager' (4c924b25-273c-4cc6-9a49-f2adb5957252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02ce13b-9560-44d3-b0ba-362a8e999e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02ce13b-9560-44d3-b0ba-362a8e999e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2137677754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bb58bf-5c16-47e3-96f6-c17ca577473c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a75060d43e4a89b89c7bfda5e561d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:45Z,use_quota=True,user_id='a13fd922c6e64cfa88c6078d42b15ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89883f3-17b2-4e80-8a60-006015b1a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89883f3-17b2-4e80-8a60-006015b1a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880bfa70-c1b4-4b76-85a6-018d24ef925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880bfa70-c1b4-4b76-85a6-018d24ef925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14bb58bf-5c16-47e3-96f6-c17ca577473c', 'volume_name': 'volume-14bb58bf-5c16-47e3-96f6-c17ca577473c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194f9222-3c5f-4adf-a3d9-48b092b60d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194f9222-3c5f-4adf-a3d9-48b092b60d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006ab24e-8e08-4916-922a-4d5caeb3f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:44 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Volume 14bb58bf-5c16-47e3-96f6-c17ca577473c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14bb58bf-5c16-47e3-96f6-c17ca577473c', 'volume_size': 1}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2137677754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bb58bf-5c16-47e3-96f6-c17ca577473c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a75060d43e4a89b89c7bfda5e561d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:45Z,use_quota=True,user_id='a13fd922c6e64cfa88c6078d42b15ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Creating volume 14bb58bf-5c16-47e3-96f6-c17ca577473c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:56:44 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:56:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-14bb58bf-5c16-47e3-96f6-c17ca577473c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:45 devstack quobyte-client[84221]: System call of process 99101 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:45 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=124, name=volume-14bb58bf-5c16-47e3-96f6-c17ca577473c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:56:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-14bb58bf-5c16-47e3-96f6-c17ca577473c 1073741824" returned: 0 in 0.331s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-14bb58bf-5c16-47e3-96f6-c17ca577473c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-14bb58bf-5c16-47e3-96f6-c17ca577473c" returned: 0 in 0.085s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] <== create_volume: return (481ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:56:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.492s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006ab24e-8e08-4916-922a-4d5caeb3f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14bb58bf-5c16-47e3-96f6-c17ca577473c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2464cdc7-bc94-4a23-89ac-3c8702f4f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Volume volume-14bb58bf-5c16-47e3-96f6-c17ca577473c (14bb58bf-5c16-47e3-96f6-c17ca577473c): created successfully
Sep 27 11:56:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2464cdc7-bc94-4a23-89ac-3c8702f4f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Flow 'volume_create_manager' (4c924b25-273c-4cc6-9a49-f2adb5957252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:45 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a1510ded-e161-46bd-9edf-055557d62b66 tempest-VolumesListAdminTestJSON-509769921 None] Created volume successfully.
Sep 27 11:56:46 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Flow 'volume_create_manager' (18759e88-455e-46ab-a664-afcaf382b242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db85715c-da5c-45fd-81b5-d1e4d85908c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db85715c-da5c-45fd-81b5-d1e4d85908c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-127033590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c99217-70de-46a9-b7e5-d112bb75cec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a75060d43e4a89b89c7bfda5e561d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:46Z,use_quota=True,user_id='a13fd922c6e64cfa88c6078d42b15ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b508d9e7-e762-45e0-9f09-559a29cfb1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b508d9e7-e762-45e0-9f09-559a29cfb1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85b0c60-e3dc-4034-9730-145e16375d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85b0c60-e3dc-4034-9730-145e16375d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c99217-70de-46a9-b7e5-d112bb75cec8', 'volume_name': 'volume-e8c99217-70de-46a9-b7e5-d112bb75cec8', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b869b0-8c2f-46a8-917d-f0875d09e8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b869b0-8c2f-46a8-917d-f0875d09e8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0735e2e-05df-4e67-b761-036d5784a702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:46 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Volume e8c99217-70de-46a9-b7e5-d112bb75cec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c99217-70de-46a9-b7e5-d112bb75cec8', 'volume_size': 1}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-127033590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c99217-70de-46a9-b7e5-d112bb75cec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a75060d43e4a89b89c7bfda5e561d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:46Z,use_quota=True,user_id='a13fd922c6e64cfa88c6078d42b15ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Creating volume e8c99217-70de-46a9-b7e5-d112bb75cec8 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:56:46 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8c99217-70de-46a9-b7e5-d112bb75cec8 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:46 devstack quobyte-client[84221]: System call of process 99105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:46 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=125, name=volume-e8c99217-70de-46a9-b7e5-d112bb75cec8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8c99217-70de-46a9-b7e5-d112bb75cec8 1073741824" returned: 0 in 0.343s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8c99217-70de-46a9-b7e5-d112bb75cec8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8c99217-70de-46a9-b7e5-d112bb75cec8" returned: 0 in 0.086s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] <== create_volume: return (498ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:56:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.511s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0735e2e-05df-4e67-b761-036d5784a702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c99217-70de-46a9-b7e5-d112bb75cec8', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23b97de-51b2-4109-b530-e69fb3c012ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:47 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Volume volume-e8c99217-70de-46a9-b7e5-d112bb75cec8 (e8c99217-70de-46a9-b7e5-d112bb75cec8): created successfully
Sep 27 11:56:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23b97de-51b2-4109-b530-e69fb3c012ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Flow 'volume_create_manager' (18759e88-455e-46ab-a664-afcaf382b242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:47 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-a8583b9a-e495-464c-bd1f-36bb1ce98116 tempest-VolumesListAdminTestJSON-509769921 None] Created volume successfully.
Sep 27 11:56:48 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:48 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:56:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Flow 'volume_create_manager' (bce4caf1-d0b5-47fc-a8ab-413ad1b27c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2837e3b6-7569-487b-a6c1-abe7e215e61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2837e3b6-7569-487b-a6c1-abe7e215e61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7879ed-a499-4580-9f8a-b8680e6cbe02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93125a95265c4d3e88e231fe0471632f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:49Z,use_quota=True,user_id='d19cf933f77345378cb403071882b999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886f3c8-87d3-455b-93df-7e5afb441756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886f3c8-87d3-455b-93df-7e5afb441756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c08baf-c930-4af5-ba75-1dfe03af7f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c08baf-c930-4af5-ba75-1dfe03af7f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d7879ed-a499-4580-9f8a-b8680e6cbe02', 'volume_name': 'volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75dc68d-1ab2-4f47-a3c7-d5a2b182df80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75dc68d-1ab2-4f47-a3c7-d5a2b182df80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338c91e0-c75a-4669-ac5f-8e5fc75e7088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:49 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Volume 9d7879ed-a499-4580-9f8a-b8680e6cbe02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02', 'volume_size': 1}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7879ed-a499-4580-9f8a-b8680e6cbe02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93125a95265c4d3e88e231fe0471632f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:56:49Z,use_quota=True,user_id='d19cf933f77345378cb403071882b999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Creating volume 9d7879ed-a499-4580-9f8a-b8680e6cbe02 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:56:49 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:49 devstack quobyte-client[84221]: System call of process 99110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:49 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=126, name=volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02 1073741824" returned: 0 in 0.341s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02" returned: 0 in 0.087s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] <== create_volume: return (496ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.507s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338c91e0-c75a-4669-ac5f-8e5fc75e7088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887ace00-18da-44c1-923d-f2e3d141f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:56:49 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Volume volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02 (9d7879ed-a499-4580-9f8a-b8680e6cbe02): created successfully
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887ace00-18da-44c1-923d-f2e3d141f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:56:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Flow 'volume_create_manager' (bce4caf1-d0b5-47fc-a8ab-413ad1b27c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:56:49 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-df3bb861-941b-4879-98db-021c9d970b86 tempest-VolumesListAdminTestJSON-945767264 None] Created volume successfully.
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Acquiring lock "cinder-9d7879ed-a499-4580-9f8a-b8680e6cbe02-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Lock "cinder-9d7879ed-a499-4580-9f8a-b8680e6cbe02-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:50 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Acquiring lock "cinder-quobyte-9d7879ed-a499-4580-9f8a-b8680e6cbe02" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "cinder-e8c99217-70de-46a9-b7e5-d112bb75cec8-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Lock "cinder-quobyte-9d7879ed-a499-4580-9f8a-b8680e6cbe02" acquired by "delete_volume" :: waited 0.021s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-e8c99217-70de-46a9-b7e5-d112bb75cec8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d62962-e26a-4368-b663-821791c5e707]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:50 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "cinder-quobyte-e8c99217-70de-46a9-b7e5-d112bb75cec8" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-quobyte-e8c99217-70de-46a9-b7e5-d112bb75cec8" acquired by "delete_volume" :: waited 0.059s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:50 devstack quobyte-client[84221]: System call of process 99114 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a972f8d9-34a3-4503-95bb-0eef53c21193]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:56:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8c99217-70de-46a9-b7e5-d112bb75cec8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02" returned: 0 in 0.642s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-9d7879ed-a499-4580-9f8a-b8680e6cbe02" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Lock "cinder-quobyte-9d7879ed-a499-4580-9f8a-b8680e6cbe02" released by "delete_volume" :: held 0.934s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8c99217-70de-46a9-b7e5-d112bb75cec8" returned: 0 in 0.609s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8c99217-70de-46a9-b7e5-d112bb75cec8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e8c99217-70de-46a9-b7e5-d112bb75cec8" returned: 0 in 0.276s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:51 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Created reservations ['e718a141-6c29-4f53-b5b4-915004169b50', 'ff46dc64-5277-41e7-a220-3d6ef16d96bc', '3d26f2b5-164f-421c-ad32-7b8fed09976d', '038f41d2-030e-46ed-820c-b8243d196518'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:56:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-quobyte-e8c99217-70de-46a9-b7e5-d112bb75cec8" released by "delete_volume" :: held 1.062s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.170s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:56:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Deleted volume successfully.
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Created reservations ['14c52bfe-98df-42a5-9dfd-1e554db64a5c', '8242cf59-2a21-4657-8a2c-b6ca6a22a888', '2e298adb-360d-4a44-89b7-6068948d0b62', '53eb94e1-2570-44ed-ba8c-34eed54ace44'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a4cf9de-40ad-474a-bf40-ffc833f1c1bf tempest-VolumesListAdminTestJSON-945767264 None] Lock "cinder-9d7879ed-a499-4580-9f8a-b8680e6cbe02-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.115s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:56:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "cinder-14bb58bf-5c16-47e3-96f6-c17ca577473c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Deleted volume successfully.
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-14bb58bf-5c16-47e3-96f6-c17ca577473c-delete_volume" acquired by "delete_volume" :: waited 0.148s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0a480afd-38c3-4d83-ad8a-7185fb157df3 tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-e8c99217-70de-46a9-b7e5-d112bb75cec8-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:53 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "cinder-quobyte-14bb58bf-5c16-47e3-96f6-c17ca577473c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-quobyte-14bb58bf-5c16-47e3-96f6-c17ca577473c" acquired by "delete_volume" :: waited 0.009s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[66576928-b022-436f-b8b8-e6816d6e46ab]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-14bb58bf-5c16-47e3-96f6-c17ca577473c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-14bb58bf-5c16-47e3-96f6-c17ca577473c" returned: 0 in 0.394s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-14bb58bf-5c16-47e3-96f6-c17ca577473c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-14bb58bf-5c16-47e3-96f6-c17ca577473c" returned: 0 in 0.087s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-quobyte-14bb58bf-5c16-47e3-96f6-c17ca577473c" released by "delete_volume" :: held 0.628s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Created reservations ['9e629412-9902-4e89-bd70-39fc6d77d32b', '15649cb7-3d83-4c5c-adc2-8d35c3e6d77c', 'df3675af-1f72-4b53-a6fe-0de50cb468ea', '9009f523-553a-4e3c-8c5a-1dec4149d973'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.087s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:56:54 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Deleted volume successfully.
Sep 27 11:56:54 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-532f0497-f94e-4832-8957-f915f85d1b2a tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-14bb58bf-5c16-47e3-96f6-c17ca577473c-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "cinder-1f925a4b-2fc9-4c7f-be0e-60bed2597c50-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-1f925a4b-2fc9-4c7f-be0e-60bed2597c50-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:55 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:56:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "cinder-quobyte-1f925a4b-2fc9-4c7f-be0e-60bed2597c50" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:56:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-quobyte-1f925a4b-2fc9-4c7f-be0e-60bed2597c50" acquired by "delete_volume" :: waited 0.011s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:56:55 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f5e8a9-42cc-4aea-aff4-d1e911d01064]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:56:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50" returned: 0 in 0.419s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1f925a4b-2fc9-4c7f-be0e-60bed2597c50" returned: 0 in 0.095s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-quobyte-1f925a4b-2fc9-4c7f-be0e-60bed2597c50" released by "delete_volume" :: held 0.675s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Created reservations ['41651a4a-89fb-4e58-9215-f91cf4807d60', 'bd4b4cb1-5f3a-475e-865e-3484f9b51f8e', 'a97f386a-d9e7-4316-a3d8-f47b91077b05', 'c6edddeb-0922-47e9-b689-c48f5c59960a'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:56:56 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Deleted volume successfully.
Sep 27 11:56:56 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3b1e1825-5f86-4e01-8326-5c246a5a6f08 tempest-VolumesListAdminTestJSON-509769921 None] Lock "cinder-1f925a4b-2fc9-4c7f-be0e-60bed2597c50-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:01 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Flow 'volume_create_manager' (62905d28-111e-4509-bcd0-8d056028bc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c769d0b-e2d4-434d-8308-28819f7550f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c769d0b-e2d4-434d-8308-28819f7550f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-748555482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b4c34e-925b-466a-aa35-f2e8884f7cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a73ebdb544c3e9fc00c0c22acdffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:01Z,use_quota=True,user_id='d5d3f9d1f66d4d82a0c40ab21079b1ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d70993-120c-4b4f-97b7-86baca467751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d70993-120c-4b4f-97b7-86baca467751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51da93e-f4b8-409c-8a5e-9b670a8e5671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51da93e-f4b8-409c-8a5e-9b670a8e5671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b4c34e-925b-466a-aa35-f2e8884f7cc9', 'volume_name': 'volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd162c4-d697-425c-a204-c12745f511b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd162c4-d697-425c-a204-c12745f511b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f717097-ae4b-4d67-baa6-e2ae1db3a4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:01 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Volume 74b4c34e-925b-466a-aa35-f2e8884f7cc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9', 'volume_size': 1}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-748555482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b4c34e-925b-466a-aa35-f2e8884f7cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3a73ebdb544c3e9fc00c0c22acdffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:01Z,use_quota=True,user_id='d5d3f9d1f66d4d82a0c40ab21079b1ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Creating volume 74b4c34e-925b-466a-aa35-f2e8884f7cc9 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:57:01 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:01 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=127, name=volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 1073741824" returned: 0 in 0.326s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9" returned: 0 in 0.084s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] <== create_volume: return (479ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:57:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.492s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f717097-ae4b-4d67-baa6-e2ae1db3a4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee8b264-10b2-4629-baac-7dbd2328b363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:02 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Volume volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 (74b4c34e-925b-466a-aa35-f2e8884f7cc9): created successfully
Sep 27 11:57:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee8b264-10b2-4629-baac-7dbd2328b363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Flow 'volume_create_manager' (62905d28-111e-4509-bcd0-8d056028bc2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:02 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-24efd111-0172-4bad-a221-281af48b58ef tempest-SnapshotMetadataTestJSON-2135864611 None] Created volume successfully.
Sep 27 11:57:03 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Creating offline snapshot 5881fc5a-8bc5-478d-86b8-180060602a49 of volume 74b4c34e-925b-466a-aa35-f2e8884f7cc9 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:57:03 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a16b88-c7f7-4d44-98f0-97549e5354f3]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9" returned: 0 in 0.392s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:04 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=128, name=volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 1G" returned: 0 in 0.233s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): qemu-img rebase -u -b volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "qemu-img rebase -u -b volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49" returned: 0 in 0.124s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.info" returned: 0 in 0.090s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.info" returned: 0 in 0.083s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.424s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:05 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-100b7415-13c8-448b-8303-52673651159a tempest-SnapshotMetadataTestJSON-2135864611 None] Create snapshot completed successfully
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Acquiring lock "cinder-5881fc5a-8bc5-478d-86b8-180060602a49-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-5881fc5a-8bc5-478d-86b8-180060602a49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:06 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Acquiring lock "cinder-quobyte-74b4c34e-925b-466a-aa35-f2e8884f7cc9" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-quobyte-74b4c34e-925b-466a-aa35-f2e8884f7cc9" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Acquiring lock "cinder-quobyte-5881fc5a-8bc5-478d-86b8-180060602a49" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-quobyte-5881fc5a-8bc5-478d-86b8-180060602a49" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Deleting offline snapshot 5881fc5a-8bc5-478d-86b8-180060602a49 of volume 74b4c34e-925b-466a-aa35-f2e8884f7cc9 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] snapshot_file for this snap is: volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7cbea0-ff45-41b6-bd6e-3df980c96886]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:06 devstack quobyte-client[84221]: System call of process 99156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49" returned: 0 in 0.376s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:57:07 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff15e6d4-17f4-4936-bbca-9a24acf69a5a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:07 devstack quobyte-client[84221]: System call of process 99159 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9" returned: 0 in 0.402s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49" returned: 0 in 0.222s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9.5881fc5a-8bc5-478d-86b8-180060602a49" returned: 0 in 0.125s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-quobyte-5881fc5a-8bc5-478d-86b8-180060602a49" released by "_delete_snapshot" :: held 1.461s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-quobyte-74b4c34e-925b-466a-aa35-f2e8884f7cc9" released by "delete_snapshot" :: held 1.494s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:08 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Created reservations ['a1e71205-2db3-468a-8636-c2ccb6630111', '14877604-7b31-4d01-995e-73b051738fb7', '23b1abe4-a67b-4a70-9da2-a491f7e308e6', '0a64ddea-0fca-446c-8c37-55817f239052'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:57:08 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Delete snapshot completed successfully.
Sep 27 11:57:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-1a4d6339-f163-4616-817c-aca416a7b5a6 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-5881fc5a-8bc5-478d-86b8-180060602a49-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Acquiring lock "cinder-74b4c34e-925b-466a-aa35-f2e8884f7cc9-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-74b4c34e-925b-466a-aa35-f2e8884f7cc9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:09 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Acquiring lock "cinder-quobyte-74b4c34e-925b-466a-aa35-f2e8884f7cc9" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-quobyte-74b4c34e-925b-466a-aa35-f2e8884f7cc9" acquired by "delete_volume" :: waited 0.018s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:09 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e272b867-97a3-43cd-8605-b117020ed613]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9" returned: 0 in 0.394s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-74b4c34e-925b-466a-aa35-f2e8884f7cc9" returned: 0 in 0.096s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-quobyte-74b4c34e-925b-466a-aa35-f2e8884f7cc9" released by "delete_volume" :: held 0.721s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Created reservations ['fd99dfb6-b2c7-41c1-96b5-b62303d43143', 'a3a0f851-c795-4104-9979-2cb96f1811b8', 'f558fce3-8ac3-4605-a2b9-359c7fc98ba0', '9d0b92af-60fd-4aeb-b71e-8d7f65c30710'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.094s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:11 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:57:11 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Deleted volume successfully.
Sep 27 11:57:11 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-489f536e-ab24-4b75-b804-1b44326bd151 tempest-SnapshotMetadataTestJSON-2135864611 None] Lock "cinder-74b4c34e-925b-466a-aa35-f2e8884f7cc9-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:15 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Flow 'volume_create_manager' (f40f24ec-d1f5-467f-beb1-b2a1da3a8bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405026d0-9b2e-499e-81f5-c990f301bf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405026d0-9b2e-499e-81f5-c990f301bf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-278199954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24b9af0-3af4-40dc-abae-5fe0871baddd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a4de309dd4c31b56b6db8ab873a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:15Z,use_quota=True,user_id='d3afe3e7cd0f45d682314efbefd149ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8195f51e-f621-488a-9084-1c3859cf4763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8195f51e-f621-488a-9084-1c3859cf4763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdb0952-702e-4fda-9dda-e20ac1937ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdb0952-702e-4fda-9dda-e20ac1937ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24b9af0-3af4-40dc-abae-5fe0871baddd', 'volume_name': 'volume-b24b9af0-3af4-40dc-abae-5fe0871baddd', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08285a8e-98d6-44b0-8c53-1bac6ecda682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08285a8e-98d6-44b0-8c53-1bac6ecda682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc70cf19-2e28-4349-9b82-1b5c8b2fad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:15 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Volume b24b9af0-3af4-40dc-abae-5fe0871baddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24b9af0-3af4-40dc-abae-5fe0871baddd', 'volume_size': 1}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-278199954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24b9af0-3af4-40dc-abae-5fe0871baddd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a4de309dd4c31b56b6db8ab873a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:15Z,use_quota=True,user_id='d3afe3e7cd0f45d682314efbefd149ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Creating volume b24b9af0-3af4-40dc-abae-5fe0871baddd {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:57:15 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b24b9af0-3af4-40dc-abae-5fe0871baddd 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:15 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=130, name=volume-b24b9af0-3af4-40dc-abae-5fe0871baddd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b24b9af0-3af4-40dc-abae-5fe0871baddd 1073741824" returned: 0 in 0.343s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b24b9af0-3af4-40dc-abae-5fe0871baddd {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b24b9af0-3af4-40dc-abae-5fe0871baddd" returned: 0 in 0.136s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] <== create_volume: return (535ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.545s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc70cf19-2e28-4349-9b82-1b5c8b2fad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24b9af0-3af4-40dc-abae-5fe0871baddd', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2c2385-80eb-4366-9122-88e859c369ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:16 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Volume volume-b24b9af0-3af4-40dc-abae-5fe0871baddd (b24b9af0-3af4-40dc-abae-5fe0871baddd): created successfully
Sep 27 11:57:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2c2385-80eb-4366-9122-88e859c369ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:16 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Flow 'volume_create_manager' (f40f24ec-d1f5-467f-beb1-b2a1da3a8bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:16 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4627df12-bb11-4933-9c80-50a129cfd5ca tempest-VolumesListTestJSON-10447848 None] Created volume successfully.
Sep 27 11:57:17 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Flow 'volume_create_manager' (a804ad23-74ef-45ae-a8a5-8aa52696ea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce8573a-414c-43bf-a68c-ced961ee77c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce8573a-414c-43bf-a68c-ced961ee77c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1015958053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59816c75-93b6-4b8a-9e51-7614b62ed8f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a4de309dd4c31b56b6db8ab873a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:18Z,use_quota=True,user_id='d3afe3e7cd0f45d682314efbefd149ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00135fd6-22b8-4c21-bdda-fef551342952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00135fd6-22b8-4c21-bdda-fef551342952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6155f685-e172-41c9-aea8-3f468aa49fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6155f685-e172-41c9-aea8-3f468aa49fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59816c75-93b6-4b8a-9e51-7614b62ed8f2', 'volume_name': 'volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e055869c-ec71-45e1-ab09-c5d07fc25c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e055869c-ec71-45e1-ab09-c5d07fc25c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ddfb55-d66d-4d91-aeee-260a677284cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:17 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Volume 59816c75-93b6-4b8a-9e51-7614b62ed8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2', 'volume_size': 1}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1015958053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59816c75-93b6-4b8a-9e51-7614b62ed8f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a4de309dd4c31b56b6db8ab873a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:18Z,use_quota=True,user_id='d3afe3e7cd0f45d682314efbefd149ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Creating volume 59816c75-93b6-4b8a-9e51-7614b62ed8f2 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:57:17 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:57:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:17 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=131, name=volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:57:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2 1073741824" returned: 0 in 0.324s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2" returned: 0 in 0.083s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:57:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.485s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ddfb55-d66d-4d91-aeee-260a677284cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffdec2c-dc1e-4940-92d4-eea7e55dbbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:18 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Volume volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2 (59816c75-93b6-4b8a-9e51-7614b62ed8f2): created successfully
Sep 27 11:57:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffdec2c-dc1e-4940-92d4-eea7e55dbbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:18 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Flow 'volume_create_manager' (a804ad23-74ef-45ae-a8a5-8aa52696ea6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:18 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-bc40e880-4d58-4f09-9d31-6939aa755f1e tempest-VolumesListTestJSON-10447848 None] Created volume successfully.
Sep 27 11:57:19 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Flow 'volume_create_manager' (6f307176-121a-427e-8fed-66cc4b809b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe77fe73-544f-49f3-91ad-a327bf50d69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe77fe73-544f-49f3-91ad-a327bf50d69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-883470849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8373ffba-38a2-4a15-acfd-df4b2bfb8c4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a4de309dd4c31b56b6db8ab873a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:19Z,use_quota=True,user_id='d3afe3e7cd0f45d682314efbefd149ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1304f8-8ce9-4e6a-b2ac-af589be0263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1304f8-8ce9-4e6a-b2ac-af589be0263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e90684-1069-4a6a-be2b-3ec5942ef6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e90684-1069-4a6a-be2b-3ec5942ef6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8373ffba-38a2-4a15-acfd-df4b2bfb8c4c', 'volume_name': 'volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a13da5-a38b-4c0a-83e1-cd19ad1554c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a13da5-a38b-4c0a-83e1-cd19ad1554c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39d881f-6f6f-43bb-9b5d-0896631f6e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:19 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Volume 8373ffba-38a2-4a15-acfd-df4b2bfb8c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c', 'volume_size': 1}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-883470849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8373ffba-38a2-4a15-acfd-df4b2bfb8c4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='452a4de309dd4c31b56b6db8ab873a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:19Z,use_quota=True,user_id='d3afe3e7cd0f45d682314efbefd149ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Creating volume 8373ffba-38a2-4a15-acfd-df4b2bfb8c4c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:57:19 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:19 devstack quobyte-client[84221]: System call of process 99219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:19 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=132, name=volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c 1073741824" returned: 0 in 0.330s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c" returned: 0 in 0.087s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] <== create_volume: return (485ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:57:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.497s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39d881f-6f6f-43bb-9b5d-0896631f6e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ffc77f-7784-4684-8aa1-7ada3335e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:20 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Volume volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c (8373ffba-38a2-4a15-acfd-df4b2bfb8c4c): created successfully
Sep 27 11:57:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ffc77f-7784-4684-8aa1-7ada3335e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:20 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Flow 'volume_create_manager' (6f307176-121a-427e-8fed-66cc4b809b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-bd2eeba0-0993-4efa-b5f1-4b19cbfd5958 tempest-VolumesListTestJSON-10447848 None] Created volume successfully.
Sep 27 11:57:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Acquiring lock "cinder-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Lock "cinder-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:24 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Acquiring lock "cinder-quobyte-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Lock "cinder-quobyte-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c" acquired by "delete_volume" :: waited 0.011s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:24 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f33ae5-158c-4db2-80ba-876d0fc7b540]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:25 devstack quobyte-client[84221]: System call of process 99223 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c" returned: 0 in 0.398s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c" returned: 0 in 0.108s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:25 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Lock "cinder-quobyte-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c" released by "delete_volume" :: held 0.649s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:25 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Created reservations ['4ed3af8a-82bd-4832-bb47-c07e37d7c274', 'a98e65f7-84d1-4a3d-bed0-26a43c3f547c', 'd14df1a4-81f1-48a9-93aa-00e3070707ae', 'c74ae275-6cb9-4d9c-9544-9f5d30e59b9e'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:57:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:26 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:57:26 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Deleted volume successfully.
Sep 27 11:57:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-b38ff23d-c618-4587-b8de-7028c3549066 tempest-VolumesListTestJSON-10447848 None] Lock "cinder-8373ffba-38a2-4a15-acfd-df4b2bfb8c4c-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Acquiring lock "cinder-59816c75-93b6-4b8a-9e51-7614b62ed8f2-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Lock "cinder-59816c75-93b6-4b8a-9e51-7614b62ed8f2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Acquiring lock "cinder-quobyte-59816c75-93b6-4b8a-9e51-7614b62ed8f2" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:27 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Lock "cinder-quobyte-59816c75-93b6-4b8a-9e51-7614b62ed8f2" acquired by "delete_volume" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:27 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[38297a18-7c12-4813-9224-e57c0d8f34e9]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2" returned: 0 in 0.403s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-59816c75-93b6-4b8a-9e51-7614b62ed8f2" returned: 0 in 0.091s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Lock "cinder-quobyte-59816c75-93b6-4b8a-9e51-7614b62ed8f2" released by "delete_volume" :: held 0.666s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Created reservations ['1ae60303-cbe0-4028-9b38-c8771f6920c2', 'bd119c4a-c0a6-4ea9-a0b7-3c1aee8eab4d', 'b5eb8b42-8167-4a75-affb-ff34eb592ba8', '9bda75fb-0c71-4f00-a947-d4d590992d8c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.086s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:57:28 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Deleted volume successfully.
Sep 27 11:57:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e82b22a6-f391-4567-828e-71cfcda09d3c tempest-VolumesListTestJSON-10447848 None] Lock "cinder-59816c75-93b6-4b8a-9e51-7614b62ed8f2-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Acquiring lock "cinder-b24b9af0-3af4-40dc-abae-5fe0871baddd-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Lock "cinder-b24b9af0-3af4-40dc-abae-5fe0871baddd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:29 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Acquiring lock "cinder-quobyte-b24b9af0-3af4-40dc-abae-5fe0871baddd" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Lock "cinder-quobyte-b24b9af0-3af4-40dc-abae-5fe0871baddd" acquired by "delete_volume" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:29 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61065bd-c2ff-4268-9ad9-4a27e326e225]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b24b9af0-3af4-40dc-abae-5fe0871baddd {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:30 devstack quobyte-client[84221]: System call of process 99234 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b24b9af0-3af4-40dc-abae-5fe0871baddd" returned: 0 in 0.390s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b24b9af0-3af4-40dc-abae-5fe0871baddd {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-b24b9af0-3af4-40dc-abae-5fe0871baddd" returned: 0 in 0.105s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Lock "cinder-quobyte-b24b9af0-3af4-40dc-abae-5fe0871baddd" released by "delete_volume" :: held 0.640s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Created reservations ['a19ec36b-e7fa-4776-a421-85d0d0d82123', 'c94e89f5-9064-4669-ab3c-ebead8a37e06', '3599336d-5885-43b7-950c-c8f81e74b6c2', '16b56d5b-2441-4b2d-9c59-d3c964da4f94'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.093s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:31 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:57:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Deleted volume successfully.
Sep 27 11:57:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-81650c0b-dc15-49ac-8646-d07829d8c6b3 tempest-VolumesListTestJSON-10447848 None] Lock "cinder-b24b9af0-3af4-40dc-abae-5fe0871baddd-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:34 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Flow 'volume_create_manager' (669ec1c9-b721-4557-8ec3-9ec2cd10cf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e3f1a7-6aaa-40f8-a31b-4fec3844146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e3f1a7-6aaa-40f8-a31b-4fec3844146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-390204639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b608f7f-09d2-4305-a006-6440d938bad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e5d35edce64dcaa6e09f3139558708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:34Z,use_quota=True,user_id='3ae4e2b2be644c9e984dc5e745728307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92461ec2-d189-4c5d-8142-e796b605999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92461ec2-d189-4c5d-8142-e796b605999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f32574-0b26-47ff-95ed-0b7377ae56ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f32574-0b26-47ff-95ed-0b7377ae56ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b608f7f-09d2-4305-a006-6440d938bad3', 'volume_name': 'volume-5b608f7f-09d2-4305-a006-6440d938bad3', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76523108-0a48-48eb-80a8-a1fde66afd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76523108-0a48-48eb-80a8-a1fde66afd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ef11d7-1c43-45d6-af18-7a7db24686f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:34 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Volume 5b608f7f-09d2-4305-a006-6440d938bad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b608f7f-09d2-4305-a006-6440d938bad3', 'volume_size': 1}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-390204639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b608f7f-09d2-4305-a006-6440d938bad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e5d35edce64dcaa6e09f3139558708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:57:34Z,use_quota=True,user_id='3ae4e2b2be644c9e984dc5e745728307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Creating volume 5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:57:34 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:57:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:34 devstack quobyte-client[84221]: System call of process 99239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:34 devstack quobyte-client[84221]: System call of process 99239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:35 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=133, name=volume-5b608f7f-09d2-4305-a006-6440d938bad3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:57:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 1073741824" returned: 0 in 0.367s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3" returned: 0 in 0.085s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] <== create_volume: return (516ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:57:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.527s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ef11d7-1c43-45d6-af18-7a7db24686f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b608f7f-09d2-4305-a006-6440d938bad3', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f926a2-a8bc-4315-8fa3-e8efc3490638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:57:35 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Volume volume-5b608f7f-09d2-4305-a006-6440d938bad3 (5b608f7f-09d2-4305-a006-6440d938bad3): created successfully
Sep 27 11:57:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f926a2-a8bc-4315-8fa3-e8efc3490638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:57:35 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Flow 'volume_create_manager' (669ec1c9-b721-4557-8ec3-9ec2cd10cf34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:57:35 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-38d81eb1-5189-41da-bd86-19aa0a8141b7 tempest-VolumesSnapshotListTestJSON-724239675 None] Created volume successfully.
Sep 27 11:57:37 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Creating offline snapshot 4b882a31-a3bf-4faa-b952-d187af255f44 of volume 5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:57:37 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc978e-d4d9-4ce9-bad0-4f8edf556b7f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3" returned: 0 in 0.403s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:37 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=134, name=volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:57:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 1G" returned: 0 in 0.254s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5b608f7f-09d2-4305-a006-6440d938bad3 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:37 devstack quobyte-client[84221]: System call of process 99250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:37 devstack quobyte-client[84221]: System call of process 99250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img rebase -u -b volume-5b608f7f-09d2-4305-a006-6440d938bad3 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44" returned: 0 in 0.148s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44" returned: 0 in 0.083s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44" returned: 0 in 0.106s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.info" returned: 0 in 0.091s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.info" returned: 0 in 0.100s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.517s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b737ed06-50dd-47c4-9dbe-689375707d1b tempest-VolumesSnapshotListTestJSON-724239675 None] Create snapshot completed successfully
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.320s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:57:39 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Creating offline snapshot bf1f865c-0e98-45f5-af2e-132146f2206e of volume 5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[17296943-490a-4f90-9971-3120c4daa131]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:40 devstack quobyte-client[84221]: System call of process 99258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44" returned: 0 in 0.388s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b608f7f-09d2-4305-a006-6440d938bad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:40 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=136, name=volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e 1G" returned: 0 in 0.313s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img rebase -u -b volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e" returned: 0 in 0.173s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e" returned: 0 in 0.085s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:57:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e" returned: 0 in 0.095s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.401s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:41 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4b752f6e-22a2-44fb-854f-9b68e2b35641 tempest-VolumesSnapshotListTestJSON-724239675 None] Create snapshot completed successfully
Sep 27 11:57:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:41 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Creating offline snapshot 5e2a77ed-d2ef-4825-ac0e-9d260b46cecf of volume 5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 11:57:41 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f299ca-84d3-498d-a51e-75e94b64e075]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e" returned: 0 in 0.400s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b608f7f-09d2-4305-a006-6440d938bad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:42 devstack quobyte-client[84221]: System call of process 99272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:42 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=137, name=volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf 1G" returned: 0 in 0.359s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:42 devstack quobyte-client[84221]: System call of process 99275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:42 devstack quobyte-client[84221]: System call of process 99275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:42 devstack quobyte-client[84221]: System call of process 99275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img rebase -u -b volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf" returned: 0 in 0.151s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf" returned: 0 in 0.099s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 11:57:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf" returned: 0 in 0.097s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.401s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:43 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=92,cinder:DELETE=12,cinder:SELECT=50,cinder:INSERT=14 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:57:43 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=70,cinder:UPDATE=92,cinder:INSERT=22,cinder:DELETE=8 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:57:43 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-042486cf-8406-4ff8-8b0a-f6651b47252a tempest-VolumesSnapshotListTestJSON-724239675 None] Create snapshot completed successfully
Sep 27 11:57:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-5e2a77ed-d2ef-4825-ac0e-9d260b46cecf-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-5e2a77ed-d2ef-4825-ac0e-9d260b46cecf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:44 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:44 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-quobyte-5e2a77ed-d2ef-4825-ac0e-9d260b46cecf" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5e2a77ed-d2ef-4825-ac0e-9d260b46cecf" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Deleting offline snapshot 5e2a77ed-d2ef-4825-ac0e-9d260b46cecf of volume 5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] snapshot_file for this snap is: volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[c284dfd5-afb1-48b4-a915-a4d244ea18f8]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf" returned: 0 in 0.374s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b608f7f-09d2-4305-a006-6440d938bad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e426ec98-cf39-43ab-abb4-1ef13d4c9f94]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e" returned: 0 in 0.420s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b608f7f-09d2-4305-a006-6440d938bad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:57:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:46 devstack quobyte-client[84221]: System call of process 99286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:46 devstack quobyte-client[84221]: System call of process 99286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf" returned: 0 in 0.343s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.5e2a77ed-d2ef-4825-ac0e-9d260b46cecf" returned: 0 in 0.083s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5e2a77ed-d2ef-4825-ac0e-9d260b46cecf" released by "_delete_snapshot" :: held 1.522s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" released by "delete_snapshot" :: held 1.542s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:46 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Created reservations ['777d2b2e-df8f-4ddc-bfef-b80bd86cd81e', '310a039f-d039-4fc3-8c18-195358a2560a', '0c35fdbc-cac2-4018-873d-728ed17e900f', 'ba7fbbb8-3795-4d6c-b82d-2e166f78626e'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:57:46 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Delete snapshot completed successfully.
Sep 27 11:57:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-35e14451-9a07-467e-be7d-4fa773c3bf49 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-5e2a77ed-d2ef-4825-ac0e-9d260b46cecf-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-bf1f865c-0e98-45f5-af2e-132146f2206e-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-bf1f865c-0e98-45f5-af2e-132146f2206e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:47 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-quobyte-bf1f865c-0e98-45f5-af2e-132146f2206e" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-bf1f865c-0e98-45f5-af2e-132146f2206e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Deleting offline snapshot bf1f865c-0e98-45f5-af2e-132146f2206e of volume 5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] snapshot_file for this snap is: volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3834822-1a62-4dcc-895c-d74f4a2db372]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e" returned: 0 in 0.372s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b608f7f-09d2-4305-a006-6440d938bad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32b3d64-9aa5-4f71-ae5f-6e9fcdb6db1a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:48 devstack quobyte-client[84221]: System call of process 99294 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44" returned: 0 in 0.385s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b608f7f-09d2-4305-a006-6440d938bad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:57:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:48 devstack quobyte-client[84221]: System call of process 99297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:48 devstack quobyte-client[84221]: System call of process 99297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:48 devstack quobyte-client[84221]: System call of process 99297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:48 devstack quobyte-client[84221]: System call of process 99297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e" returned: 0 in 0.240s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.bf1f865c-0e98-45f5-af2e-132146f2206e" returned: 0 in 0.093s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-bf1f865c-0e98-45f5-af2e-132146f2206e" released by "_delete_snapshot" :: held 1.419s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:48 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" released by "delete_snapshot" :: held 1.479s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:48 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Created reservations ['aa88c21c-51c8-45f0-9f7f-02844ca8b820', 'd597c00c-48c7-48d9-95bb-16f9a802f4ee', '93186807-ec73-4219-bf52-76b8cadc3b21', '49f3465d-8924-41b6-973b-e1d076ede2ed'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:57:49 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Delete snapshot completed successfully.
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8ed5043e-6e3f-45e5-b8b0-6f134ee66afc tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-bf1f865c-0e98-45f5-af2e-132146f2206e-delete_snapshot" released by "delete_snapshot" :: held 1.891s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-4b882a31-a3bf-4faa-b952-d187af255f44-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-4b882a31-a3bf-4faa-b952-d187af255f44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:49 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-quobyte-4b882a31-a3bf-4faa-b952-d187af255f44" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-4b882a31-a3bf-4faa-b952-d187af255f44" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Deleting offline snapshot 4b882a31-a3bf-4faa-b952-d187af255f44 of volume 5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] snapshot_file for this snap is: volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcde356-8d9c-406b-a831-f319f74229d9]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44" returned: 0 in 0.385s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b608f7f-09d2-4305-a006-6440d938bad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1750d45a-161f-4d9a-ac12-96abd9d799ac]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3" returned: 0 in 0.398s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:50 devstack quobyte-client[84221]: System call of process 99307 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:57:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44" returned: 0 in 0.242s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3.4b882a31-a3bf-4faa-b952-d187af255f44" returned: 0 in 0.090s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-4b882a31-a3bf-4faa-b952-d187af255f44" released by "_delete_snapshot" :: held 1.405s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" released by "delete_snapshot" :: held 1.426s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:50 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Created reservations ['11ab3ac4-2958-4cf9-aa0b-49f7bd8b2e0c', '60bcc856-fc09-451d-9213-b1e719b61209', 'f8b2462b-0cbf-4bdc-9788-d935913c05ff', '603fd177-3c91-4c6f-b1c5-b07c31bf9aa3'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:57:51 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Delete snapshot completed successfully.
Sep 27 11:57:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-73ce925a-8f44-4606-a046-cf209efba158 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-4b882a31-a3bf-4faa-b952-d187af255f44-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-5b608f7f-09d2-4305-a006-6440d938bad3-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-5b608f7f-09d2-4305-a006-6440d938bad3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:51 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:57:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 11:57:51 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" acquired by "delete_volume" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 11:57:51 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc5b1fe-3881-41c8-98ee-7bcf698de859]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:57:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3" returned: 0 in 0.390s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5b608f7f-09d2-4305-a006-6440d938bad3" returned: 0 in 0.111s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-quobyte-5b608f7f-09d2-4305-a006-6440d938bad3" released by "delete_volume" :: held 0.661s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Created reservations ['79160141-9d70-429e-8c70-b7cd0d53a04f', '2accf86b-7e6e-4591-a31c-0f35debb9e60', '5cdf7d7d-f2da-44e1-87c8-fd3b2b210ce9', '0d44a0ea-0899-4828-86c9-7ec13d15dc31'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.145s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:57:52 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:57:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Deleted volume successfully.
Sep 27 11:57:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-9d54a01e-192a-456f-bec6-93e504ed8d77 tempest-VolumesSnapshotListTestJSON-724239675 None] Lock "cinder-5b608f7f-09d2-4305-a006-6440d938bad3-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 11:58:02 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=34 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:58:03 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:DELETE=2,cinder:SELECT=18,cinder:INSERT=11,cinder:UPDATE=15 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:58:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:58:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:58:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:58:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:58:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:58:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:58:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:58:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.102s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:58:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:58:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Flow 'volume_create_manager' (3983343c-dfe6-4f7d-99d3-ce1b7c0a3a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2438d70-1d8f-42d1-a7bd-39a8b22b135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2438d70-1d8f-42d1-a7bd-39a8b22b135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1911082298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ddb3f96-44f9-43e4-9673-b2aaf8178f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40986213d2364b99b839979e5e250a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:58:45Z,use_quota=True,user_id='adf2059c86244447b9af31f465aa9f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cc137c-b5f9-40cf-a978-bfd2f72ce2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cc137c-b5f9-40cf-a978-bfd2f72ce2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64da70d5-5333-42eb-a081-c7d74f82090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64da70d5-5333-42eb-a081-c7d74f82090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ddb3f96-44f9-43e4-9673-b2aaf8178f77', 'volume_name': 'volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c66a3a7-8f74-468d-81c8-fc49793ae58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c66a3a7-8f74-468d-81c8-fc49793ae58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b1c163-2b2d-4fbf-ba06-618ce4862c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:58:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Volume 8ddb3f96-44f9-43e4-9673-b2aaf8178f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77', 'volume_size': 1}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T09:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1911082298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ddb3f96-44f9-43e4-9673-b2aaf8178f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40986213d2364b99b839979e5e250a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T09:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T09:58:45Z,use_quota=True,user_id='adf2059c86244447b9af31f465aa9f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Creating volume 8ddb3f96-44f9-43e4-9673-b2aaf8178f77 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 11:58:45 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:58:45 devstack quobyte-client[84221]: System call of process 99475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:58:45 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=138, name=volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77 1073741824" returned: 0 in 0.408s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] <== create_volume: return (601ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 11:58:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.613s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:58:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b1c163-2b2d-4fbf-ba06-618ce4862c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:58:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e445538-5065-4870-a14f-7615f6a0f612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 11:58:46 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Volume volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77 (8ddb3f96-44f9-43e4-9673-b2aaf8178f77): created successfully
Sep 27 11:58:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e445538-5065-4870-a14f-7615f6a0f612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 11:58:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Flow 'volume_create_manager' (3983343c-dfe6-4f7d-99d3-ce1b7c0a3a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 11:58:46 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0b7accf9-e563-4630-a8ff-7fac1d84f051 tempest-TestMinimumBasicScenario-602395984 None] Created volume successfully.
Sep 27 11:58:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-f3889847-1ba6-44ed-9960-21481aa4fb0d req-62abbfd3-cd4e-422d-8616-ecfdda19e44b tempest-TestMinimumBasicScenario-602395984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:58:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-f3889847-1ba6-44ed-9960-21481aa4fb0d req-62abbfd3-cd4e-422d-8616-ecfdda19e44b tempest-TestMinimumBasicScenario-602395984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:58:51 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee5427b-ff34-41f2-9f2d-95e9d195ba06]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 11:58:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-f3889847-1ba6-44ed-9960-21481aa4fb0d req-62abbfd3-cd4e-422d-8616-ecfdda19e44b tempest-TestMinimumBasicScenario-602395984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:58:51 devstack quobyte-client[84221]: System call of process 99488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:58:51 devstack quobyte-client[84221]: System call of process 99488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:58:51 devstack quobyte-client[84221]: System call of process 99488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 11:58:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-f3889847-1ba6-44ed-9960-21481aa4fb0d req-62abbfd3-cd4e-422d-8616-ecfdda19e44b tempest-TestMinimumBasicScenario-602395984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77" returned: 0 in 0.462s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:58:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-f3889847-1ba6-44ed-9960-21481aa4fb0d req-62abbfd3-cd4e-422d-8616-ecfdda19e44b tempest-TestMinimumBasicScenario-602395984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.526s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:58:52 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-f3889847-1ba6-44ed-9960-21481aa4fb0d req-62abbfd3-cd4e-422d-8616-ecfdda19e44b tempest-TestMinimumBasicScenario-602395984 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06fe60f5-060d-4dca-b00a-b3ce647e4504', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 11:58:52 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-f3889847-1ba6-44ed-9960-21481aa4fb0d req-62abbfd3-cd4e-422d-8616-ecfdda19e44b tempest-TestMinimumBasicScenario-602395984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 11:58:52 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-f3889847-1ba6-44ed-9960-21481aa4fb0d req-62abbfd3-cd4e-422d-8616-ecfdda19e44b tempest-TestMinimumBasicScenario-602395984 None] attachment_update completed successfully.
Sep 27 11:59:02 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:59:02 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:59:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 11:59:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 11:59:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 11:59:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 11:59:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 11:59:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 11:59:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 11:59:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.186s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 11:59:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 11:59:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 11:59:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:00:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:00:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:00:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:00:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:00:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:00:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:00:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:00:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.107s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:00:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:01:26 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-37737300-0f8c-4f37-8c3c-3919965e2695 req-2ae7ce2b-ffd6-44e8-8a0d-73f4da4feb03 tempest-TestMinimumBasicScenario-602395984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:01:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-37737300-0f8c-4f37-8c3c-3919965e2695 req-2ae7ce2b-ffd6-44e8-8a0d-73f4da4feb03 tempest-TestMinimumBasicScenario-602395984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:01:27 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-37737300-0f8c-4f37-8c3c-3919965e2695 req-2ae7ce2b-ffd6-44e8-8a0d-73f4da4feb03 tempest-TestMinimumBasicScenario-602395984 None] Terminate volume connection completed successfully.
Sep 27 12:01:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-37737300-0f8c-4f37-8c3c-3919965e2695 req-2ae7ce2b-ffd6-44e8-8a0d-73f4da4feb03 tempest-TestMinimumBasicScenario-602395984 None] Deleting attachment 06fe60f5-060d-4dca-b00a-b3ce647e4504. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 12:01:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Acquiring lock "cinder-8ddb3f96-44f9-43e4-9673-b2aaf8178f77-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:01:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Lock "cinder-8ddb3f96-44f9-43e4-9673-b2aaf8178f77-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:01:29 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:01:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Acquiring lock "cinder-quobyte-8ddb3f96-44f9-43e4-9673-b2aaf8178f77" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:01:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Lock "cinder-quobyte-8ddb3f96-44f9-43e4-9673-b2aaf8178f77" acquired by "delete_volume" :: waited 0.011s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:01:29 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1ad226-62aa-44f1-9028-bf1128c16732]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:01:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77" returned: 0 in 0.431s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-8ddb3f96-44f9-43e4-9673-b2aaf8178f77" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Lock "cinder-quobyte-8ddb3f96-44f9-43e4-9673-b2aaf8178f77" released by "delete_volume" :: held 0.683s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Created reservations ['735ba62a-7a0a-4985-97b1-87a8c7166e61', '0fe11876-8d7b-4e9f-9c12-1dd1f02b9db7', '50ff81cb-2899-4529-adcc-4f1fef989b15', '3ec2bbce-a11a-453d-98a1-23d4a7fc411e'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.082s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:01:30 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:01:30 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Deleted volume successfully.
Sep 27 12:01:31 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c5576332-58c4-4943-a79c-0d7851cdb7a1 tempest-TestMinimumBasicScenario-602395984 None] Lock "cinder-8ddb3f96-44f9-43e4-9673-b2aaf8178f77-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:01:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:01:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:01:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:01:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:01:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:01:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:01:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:01:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.112s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:01:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:01:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:01:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:02:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:02:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:02:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:02:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:02:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:02:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:02:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:02:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.158s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:02:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:03:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:03:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:03:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:03:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:03:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:03:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:03:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:03:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.085s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:03:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:03:44 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Flow 'volume_create_manager' (56d40bb3-a155-4304-86b7-ff32b01b316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2839271f-d02c-4636-8404-e7224664999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2839271f-d02c-4636-8404-e7224664999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1413795756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b37e84-a1a3-4252-9a14-1c055e08e030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f58501d8a042ffb70427b3fcb5f401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:03:44Z,use_quota=True,user_id='4e16f3420df94b3b89308f7027fcd01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9db9645-599b-4f2f-ab81-7fbc22c6cf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9db9645-599b-4f2f-ab81-7fbc22c6cf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdfde53-cb0e-4105-9ccc-763fa940fe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdfde53-cb0e-4105-9ccc-763fa940fe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b37e84-a1a3-4252-9a14-1c055e08e030', 'volume_name': 'volume-75b37e84-a1a3-4252-9a14-1c055e08e030', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18524b4-c33a-463d-a6e5-c5df16607505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18524b4-c33a-463d-a6e5-c5df16607505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896ced8d-6eb3-46e0-b5b9-be81f54bf99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:03:44 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Volume 75b37e84-a1a3-4252-9a14-1c055e08e030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b37e84-a1a3-4252-9a14-1c055e08e030', 'volume_size': 1}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1413795756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b37e84-a1a3-4252-9a14-1c055e08e030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f58501d8a042ffb70427b3fcb5f401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:03:44Z,use_quota=True,user_id='4e16f3420df94b3b89308f7027fcd01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Creating volume 75b37e84-a1a3-4252-9a14-1c055e08e030 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:03:44 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:03:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:03:44 devstack quobyte-client[84221]: System call of process 100606 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:03:44 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=139, name=volume-75b37e84-a1a3-4252-9a14-1c055e08e030, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:03:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030 1073741824" returned: 0 in 0.368s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:03:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:03:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030" returned: 0 in 0.078s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:03:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] <== create_volume: return (508ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:03:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.519s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:03:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896ced8d-6eb3-46e0-b5b9-be81f54bf99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b37e84-a1a3-4252-9a14-1c055e08e030', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:03:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74af3297-5bcc-42a8-a5a2-78f199435a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:03:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Volume volume-75b37e84-a1a3-4252-9a14-1c055e08e030 (75b37e84-a1a3-4252-9a14-1c055e08e030): created successfully
Sep 27 12:03:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74af3297-5bcc-42a8-a5a2-78f199435a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:03:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Flow 'volume_create_manager' (56d40bb3-a155-4304-86b7-ff32b01b316b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:03:45 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-94dcaa1b-a8da-43a3-b55e-8fde8f18c147 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Created volume successfully.
Sep 27 12:03:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-3bbae708-7704-41dd-a5dc-4c6de372fabc req-f779bff9-6860-4be3-b20f-324b4524af3a tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:03:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-3bbae708-7704-41dd-a5dc-4c6de372fabc req-f779bff9-6860-4be3-b20f-324b4524af3a tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:03:50 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[d800f973-a2df-4154-aef7-d755f99b7588]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:03:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-3bbae708-7704-41dd-a5dc-4c6de372fabc req-f779bff9-6860-4be3-b20f-324b4524af3a tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:03:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-3bbae708-7704-41dd-a5dc-4c6de372fabc req-f779bff9-6860-4be3-b20f-324b4524af3a tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030" returned: 0 in 0.396s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:03:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-3bbae708-7704-41dd-a5dc-4c6de372fabc req-f779bff9-6860-4be3-b20f-324b4524af3a tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.457s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:03:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-3bbae708-7704-41dd-a5dc-4c6de372fabc req-f779bff9-6860-4be3-b20f-324b4524af3a tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-75b37e84-a1a3-4252-9a14-1c055e08e030', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '191f126f-8156-4974-b7da-03e443bd4dc6', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 12:03:50 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-3bbae708-7704-41dd-a5dc-4c6de372fabc req-f779bff9-6860-4be3-b20f-324b4524af3a tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:03:51 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-3bbae708-7704-41dd-a5dc-4c6de372fabc req-f779bff9-6860-4be3-b20f-324b4524af3a tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] attachment_update completed successfully.
Sep 27 12:04:01 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:04:01 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:04:19 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-cb919ece-ae17-4adf-b89a-729fb9b7a94f req-9194fa0a-72fd-46b7-b091-9d04889ef900 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:04:19 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-cb919ece-ae17-4adf-b89a-729fb9b7a94f req-9194fa0a-72fd-46b7-b091-9d04889ef900 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:04:19 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-cb919ece-ae17-4adf-b89a-729fb9b7a94f req-9194fa0a-72fd-46b7-b091-9d04889ef900 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Terminate volume connection completed successfully.
Sep 27 12:04:19 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-cb919ece-ae17-4adf-b89a-729fb9b7a94f req-9194fa0a-72fd-46b7-b091-9d04889ef900 tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Deleting attachment 191f126f-8156-4974-b7da-03e443bd4dc6. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Acquiring lock "cinder-75b37e84-a1a3-4252-9a14-1c055e08e030-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "cinder-75b37e84-a1a3-4252-9a14-1c055e08e030-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:04:22 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Acquiring lock "cinder-quobyte-75b37e84-a1a3-4252-9a14-1c055e08e030" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "cinder-quobyte-75b37e84-a1a3-4252-9a14-1c055e08e030" acquired by "delete_volume" :: waited 0.013s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1973f263-7320-43c8-975a-9e0fd2d3fffc]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030" returned: 0 in 0.395s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-75b37e84-a1a3-4252-9a14-1c055e08e030" returned: 0 in 0.104s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:04:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "cinder-quobyte-75b37e84-a1a3-4252-9a14-1c055e08e030" released by "delete_volume" :: held 0.636s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Created reservations ['49198717-6bd5-47ee-9d7d-431546253fb5', '63936234-5386-4b0c-96e6-358735e376f8', 'a074f1b9-9d2f-46f1-925f-a255626ca144', '84134d42-d8e0-468d-a038-0986672d7356'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.119s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:04:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Deleted volume successfully.
Sep 27 12:04:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-7bdb7462-d289-41c2-86bf-d434ca541eca tempest-TestServerVolumeAttachScenarioOldVersion-1845254444 None] Lock "cinder-75b37e84-a1a3-4252-9a14-1c055e08e030-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:04:33 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:04:33 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:04:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:04:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:04:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:04:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:04:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:04:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:04:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:04:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.091s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:04:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:05:05 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:05:05 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:05:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Flow 'volume_create_manager' (4d53bea4-9286-4a57-a383-28b48a1a366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:05:05 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db9924c-73ab-4df3-9566-e3ac4b728671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db9924c-73ab-4df3-9566-e3ac4b728671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1145421579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fec9deb-1f92-46ba-941b-a22045e7acfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3255d149b913413bba59264f82fdaaca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:05:06Z,use_quota=True,user_id='50f4b0e8795d447c9a46cbdb0d52b05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc86eb24-5359-4915-8052-ec7fa7ca00ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc86eb24-5359-4915-8052-ec7fa7ca00ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d4d02d-5396-4455-a4a4-c167a79eb300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d4d02d-5396-4455-a4a4-c167a79eb300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fec9deb-1f92-46ba-941b-a22045e7acfe', 'volume_name': 'volume-1fec9deb-1f92-46ba-941b-a22045e7acfe', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c2ed8f-9008-4bf2-bf13-75a86212c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c2ed8f-9008-4bf2-bf13-75a86212c851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc58f4ad-b1c5-46e0-be2e-967f51057aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:06 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume 1fec9deb-1f92-46ba-941b-a22045e7acfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fec9deb-1f92-46ba-941b-a22045e7acfe', 'volume_size': 1}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1145421579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fec9deb-1f92-46ba-941b-a22045e7acfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3255d149b913413bba59264f82fdaaca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:05:06Z,use_quota=True,user_id='50f4b0e8795d447c9a46cbdb0d52b05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Creating volume 1fec9deb-1f92-46ba-941b-a22045e7acfe {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:05:06 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:05:06 devstack quobyte-client[84221]: System call of process 101156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:05:06 devstack quobyte-client[84221]: System call of process 101156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:05:06 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=140, name=volume-1fec9deb-1f92-46ba-941b-a22045e7acfe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:05:06 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Flow 'volume_create_manager' (283852b0-ddf8-4266-8195-c228d102bc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740e60e3-6735-439e-997a-acaa26b8818c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe 1073741824" returned: 0 in 0.594s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:05:06 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740e60e3-6735-439e-997a-acaa26b8818c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1293873644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c7bbbb-4113-4366-9843-01641aa27aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3255d149b913413bba59264f82fdaaca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:05:06Z,use_quota=True,user_id='50f4b0e8795d447c9a46cbdb0d52b05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c543c033-0638-4d13-88f6-e13e5d300b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c543c033-0638-4d13-88f6-e13e5d300b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dc11c0-8d14-487e-922f-c9edf8708825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dc11c0-8d14-487e-922f-c9edf8708825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c7bbbb-4113-4366-9843-01641aa27aed', 'volume_name': 'volume-54c7bbbb-4113-4366-9843-01641aa27aed', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0755afd1-2711-4142-b8b3-95fae2b4fd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0755afd1-2711-4142-b8b3-95fae2b4fd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af64ca1b-91e2-4431-a6ad-7b5af1b7a202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:07 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume 54c7bbbb-4113-4366-9843-01641aa27aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c7bbbb-4113-4366-9843-01641aa27aed', 'volume_size': 1}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe" returned: 0 in 0.352s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] <== create_volume: return (971ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1293873644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c7bbbb-4113-4366-9843-01641aa27aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3255d149b913413bba59264f82fdaaca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:05:06Z,use_quota=True,user_id='50f4b0e8795d447c9a46cbdb0d52b05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Creating volume 54c7bbbb-4113-4366-9843-01641aa27aed {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:05:07 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:05:07 devstack quobyte-client[84221]: System call of process 101160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:05:07 devstack quobyte-client[84221]: System call of process 101160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:05:07 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=141, name=volume-54c7bbbb-4113-4366-9843-01641aa27aed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc58f4ad-b1c5-46e0-be2e-967f51057aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fec9deb-1f92-46ba-941b-a22045e7acfe', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2a913c-485e-44c5-9811-4f57a01faef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:07 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume volume-1fec9deb-1f92-46ba-941b-a22045e7acfe (1fec9deb-1f92-46ba-941b-a22045e7acfe): created successfully
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2a913c-485e-44c5-9811-4f57a01faef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Flow 'volume_create_manager' (4d53bea4-9286-4a57-a383-28b48a1a366e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:05:07 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-26592cea-6571-432b-85e6-74b7cf235ff5 tempest-TestServerVolumeAttachmentScenario-820928650 None] Created volume successfully.
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed 1073741824" returned: 0 in 0.499s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed" returned: 0 in 0.146s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] <== create_volume: return (688ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af64ca1b-91e2-4431-a6ad-7b5af1b7a202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c7bbbb-4113-4366-9843-01641aa27aed', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:07 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc8ce8c-6728-49a1-a2b2-b2c2a6877b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:05:08 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume volume-54c7bbbb-4113-4366-9843-01641aa27aed (54c7bbbb-4113-4366-9843-01641aa27aed): created successfully
Sep 27 12:05:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc8ce8c-6728-49a1-a2b2-b2c2a6877b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:05:08 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Flow 'volume_create_manager' (283852b0-ddf8-4266-8195-c228d102bc10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:05:08 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-b2295eaf-361f-408d-a5f9-a0a8e3754877 tempest-TestServerVolumeAttachmentScenario-820928650 None] Created volume successfully.
Sep 27 12:05:17 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:05:18 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:DELETE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:05:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:05:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:05:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:05:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:05:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:05:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:05:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:05:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.134s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:05:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:05:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:05:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:06:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:06:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:06:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:06:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:06:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:06:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:06:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:06:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.079s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:06:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:06:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-73bb7f92-93eb-4d53-a5f2-e8f88d0f79c7 req-1f159fbf-93fd-402a-bd44-d096a3017668 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:06:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-73bb7f92-93eb-4d53-a5f2-e8f88d0f79c7 req-1f159fbf-93fd-402a-bd44-d096a3017668 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:06:40 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c745fc-f2ce-4532-89d5-d72ca6aec908]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:06:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-73bb7f92-93eb-4d53-a5f2-e8f88d0f79c7 req-1f159fbf-93fd-402a-bd44-d096a3017668 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:06:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-73bb7f92-93eb-4d53-a5f2-e8f88d0f79c7 req-1f159fbf-93fd-402a-bd44-d096a3017668 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe" returned: 0 in 0.419s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:06:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-73bb7f92-93eb-4d53-a5f2-e8f88d0f79c7 req-1f159fbf-93fd-402a-bd44-d096a3017668 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.482s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:06:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-73bb7f92-93eb-4d53-a5f2-e8f88d0f79c7 req-1f159fbf-93fd-402a-bd44-d096a3017668 tempest-TestServerVolumeAttachmentScenario-820928650 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-1fec9deb-1f92-46ba-941b-a22045e7acfe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '761f772f-3041-4b99-b7e3-7513574a731f', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 12:06:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-73bb7f92-93eb-4d53-a5f2-e8f88d0f79c7 req-1f159fbf-93fd-402a-bd44-d096a3017668 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:06:41 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-73bb7f92-93eb-4d53-a5f2-e8f88d0f79c7 req-1f159fbf-93fd-402a-bd44-d096a3017668 tempest-TestServerVolumeAttachmentScenario-820928650 None] attachment_update completed successfully.
Sep 27 12:06:51 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:06:51 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:06:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-1c3ec279-ddc5-4dd1-900d-a587769dd735 req-00cf808a-5234-4c3b-af98-49e6ffd59380 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:06:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-1c3ec279-ddc5-4dd1-900d-a587769dd735 req-00cf808a-5234-4c3b-af98-49e6ffd59380 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:06:53 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e654e00a-4254-4e90-b968-b580209f9da1]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:06:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1c3ec279-ddc5-4dd1-900d-a587769dd735 req-00cf808a-5234-4c3b-af98-49e6ffd59380 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:06:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [req-1c3ec279-ddc5-4dd1-900d-a587769dd735 req-00cf808a-5234-4c3b-af98-49e6ffd59380 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed" returned: 0 in 0.379s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:06:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [req-1c3ec279-ddc5-4dd1-900d-a587769dd735 req-00cf808a-5234-4c3b-af98-49e6ffd59380 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.436s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:06:54 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-1c3ec279-ddc5-4dd1-900d-a587769dd735 req-00cf808a-5234-4c3b-af98-49e6ffd59380 tempest-TestServerVolumeAttachmentScenario-820928650 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8', 'name': 'volume-54c7bbbb-4113-4366-9843-01641aa27aed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc2cd4c3-7b96-4dba-adcb-c877e5a6b5e3', 'enforce_multipath': True} {{(pid=84197) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 27 12:06:54 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-1c3ec279-ddc5-4dd1-900d-a587769dd735 req-00cf808a-5234-4c3b-af98-49e6ffd59380 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:06:54 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-1c3ec279-ddc5-4dd1-900d-a587769dd735 req-00cf808a-5234-4c3b-af98-49e6ffd59380 tempest-TestServerVolumeAttachmentScenario-820928650 None] attachment_update completed successfully.
Sep 27 12:07:04 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:07:04 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:07:21 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-73820fab-5b40-4a40-8784-6313693906ca req-544f988c-4cea-4141-97de-6aee7e231ef0 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:07:21 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-73820fab-5b40-4a40-8784-6313693906ca req-544f988c-4cea-4141-97de-6aee7e231ef0 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:07:21 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-73820fab-5b40-4a40-8784-6313693906ca req-544f988c-4cea-4141-97de-6aee7e231ef0 tempest-TestServerVolumeAttachmentScenario-820928650 None] Terminate volume connection completed successfully.
Sep 27 12:07:21 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-73820fab-5b40-4a40-8784-6313693906ca req-544f988c-4cea-4141-97de-6aee7e231ef0 tempest-TestServerVolumeAttachmentScenario-820928650 None] Deleting attachment cc2cd4c3-7b96-4dba-adcb-c877e5a6b5e3. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 12:07:31 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:07:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:07:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:07:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:07:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:07:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:07:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:07:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:07:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.108s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:07:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:07:44 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:07:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-68be2c63-efd9-485f-a2d6-e9f1dd8a7a7e req-073422b6-efd4-4098-926f-f5e712ee990e tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:07:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [req-68be2c63-efd9-485f-a2d6-e9f1dd8a7a7e req-073422b6-efd4-4098-926f-f5e712ee990e tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:07:45 devstack cinder-volume[84197]: INFO cinder.volume.manager [req-68be2c63-efd9-485f-a2d6-e9f1dd8a7a7e req-073422b6-efd4-4098-926f-f5e712ee990e tempest-TestServerVolumeAttachmentScenario-820928650 None] Terminate volume connection completed successfully.
Sep 27 12:07:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [req-68be2c63-efd9-485f-a2d6-e9f1dd8a7a7e req-073422b6-efd4-4098-926f-f5e712ee990e tempest-TestServerVolumeAttachmentScenario-820928650 None] Deleting attachment 761f772f-3041-4b99-b7e3-7513574a731f. {{(pid=84197) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 27 12:07:55 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:07:55 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=1 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:07:56 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "cinder-54c7bbbb-4113-4366-9843-01641aa27aed-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:07:56 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "cinder-54c7bbbb-4113-4366-9843-01641aa27aed-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:07:56 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:07:56 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "cinder-quobyte-54c7bbbb-4113-4366-9843-01641aa27aed" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:07:56 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "cinder-quobyte-54c7bbbb-4113-4366-9843-01641aa27aed" acquired by "delete_volume" :: waited 0.009s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:07:56 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1fb118-7e74-4c63-a54e-08dc7cdd8cea]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:07:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:07:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed" returned: 0 in 0.409s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-54c7bbbb-4113-4366-9843-01641aa27aed" returned: 0 in 0.097s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "cinder-quobyte-54c7bbbb-4113-4366-9843-01641aa27aed" released by "delete_volume" :: held 0.645s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Created reservations ['5f8561ff-ee4e-46e5-ba6a-c5041f3fdcf9', 'a8ff4749-7fec-406b-b627-25defbc9d690', '1e3330d4-61c1-4530-be62-764498770869', '084b1060-e1a9-454c-99f8-db6e68d5abda'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "cinder-1fec9deb-1f92-46ba-941b-a22045e7acfe-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.272s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "cinder-1fec9deb-1f92-46ba-941b-a22045e7acfe-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:07:57 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Deleted volume successfully.
Sep 27 12:07:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-3d488865-6161-4fa8-924a-d36a047f2c52 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "cinder-54c7bbbb-4113-4366-9843-01641aa27aed-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:07:58 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:07:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "cinder-quobyte-1fec9deb-1f92-46ba-941b-a22045e7acfe" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:07:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "cinder-quobyte-1fec9deb-1f92-46ba-941b-a22045e7acfe" acquired by "delete_volume" :: waited 0.013s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:07:58 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1cc97f-af19-4c5f-a8b8-115eec173b1d]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:07:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:07:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe" returned: 0 in 0.396s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:07:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:07:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-1fec9deb-1f92-46ba-941b-a22045e7acfe" returned: 0 in 0.086s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:07:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "cinder-quobyte-1fec9deb-1f92-46ba-941b-a22045e7acfe" released by "delete_volume" :: held 0.644s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:07:58 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Created reservations ['4feb2e95-155d-45c6-9952-18b3ad225706', '7ba293f9-4d0f-4990-908b-31575c1479b6', '082d3c3c-3912-44e8-873e-badd71620a5f', 'db34a396-f930-4c18-9027-8245ee4f5c00'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:07:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:07:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:07:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:07:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:07:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:07:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:07:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.081s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:07:59 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:07:59 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Deleted volume successfully.
Sep 27 12:07:59 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f901de04-288f-47df-a8dd-2254485df759 tempest-TestServerVolumeAttachmentScenario-820928650 None] Lock "cinder-1fec9deb-1f92-46ba-941b-a22045e7acfe-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:09 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=22,cinder:SELECT=9,cinder:INSERT=5 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:08:09 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:08:11 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:11 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Flow 'volume_create_manager' (bd592c99-a206-481e-8d51-b4d8446b6b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d4f86e-6f93-4c4d-a5f8-b716e32ef747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d4f86e-6f93-4c4d-a5f8-b716e32ef747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc9c90a31304182a1392790db5186b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:12Z,use_quota=True,user_id='2a4cbbbf768a43e8ba44fba317f7c57b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d15aff-7079-49ef-9df0-e9620300e103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d15aff-7079-49ef-9df0-e9620300e103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077f5295-df99-4bc9-ab32-86150e4f7567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077f5295-df99-4bc9-ab32-86150e4f7567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2426b08-f942-4eb8-9ce1-e98d2dc2ec8c', 'volume_name': 'volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2bd1b7-cbfe-4c02-8dbc-f031d3e8eb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2bd1b7-cbfe-4c02-8dbc-f031d3e8eb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58c0bc2-dffd-4049-bd4f-fd596a8de201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:12 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Volume d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c', 'volume_size': 1}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc9c90a31304182a1392790db5186b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:12Z,use_quota=True,user_id='2a4cbbbf768a43e8ba44fba317f7c57b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Creating volume d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:12 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:12 devstack quobyte-client[84221]: System call of process 102040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:12 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=142, name=volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c 1073741824" returned: 0 in 0.324s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c" returned: 0 in 0.080s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] <== create_volume: return (468ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.480s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58c0bc2-dffd-4049-bd4f-fd596a8de201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef97f2d-f833-44b6-8d6d-65e72c69d17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:12 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Volume volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c (d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c): created successfully
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef97f2d-f833-44b6-8d6d-65e72c69d17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:12 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Flow 'volume_create_manager' (bd592c99-a206-481e-8d51-b4d8446b6b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:12 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7a463422-7c49-4147-ab59-cb8d0fdaee5e tempest-CinderUnicodeTest-35021332 None] Created volume successfully.
Sep 27 12:08:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Flow 'volume_create_manager' (80e849c7-7b1f-4a07-93d1-5e9d193792ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c331fcc7-c873-4bc2-b36a-6a5f5e2e5269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c331fcc7-c873-4bc2-b36a-6a5f5e2e5269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1445319338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e0d3e1-879b-423d-bf89-c555de885729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc9c90a31304182a1392790db5186b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:14Z,use_quota=True,user_id='2a4cbbbf768a43e8ba44fba317f7c57b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f520313-0ef9-4f90-bbcf-6b610b8a6765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f520313-0ef9-4f90-bbcf-6b610b8a6765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8855cf24-f6c0-4010-9045-80a92325f6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8855cf24-f6c0-4010-9045-80a92325f6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e0d3e1-879b-423d-bf89-c555de885729', 'volume_name': 'volume-d3e0d3e1-879b-423d-bf89-c555de885729', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57e6727-1db6-44c9-a4f8-0cf703de93c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57e6727-1db6-44c9-a4f8-0cf703de93c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4591144-4a8b-4110-a354-2a4197c4b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:14 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Volume d3e0d3e1-879b-423d-bf89-c555de885729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e0d3e1-879b-423d-bf89-c555de885729', 'volume_size': 1}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1445319338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e0d3e1-879b-423d-bf89-c555de885729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc9c90a31304182a1392790db5186b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:14Z,use_quota=True,user_id='2a4cbbbf768a43e8ba44fba317f7c57b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Creating volume d3e0d3e1-879b-423d-bf89-c555de885729 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:14 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:14 devstack quobyte-client[84221]: System call of process 102045 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:14 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=143, name=volume-d3e0d3e1-879b-423d-bf89-c555de885729, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 1073741824" returned: 0 in 0.307s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729" returned: 0 in 0.083s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] <== create_volume: return (454ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.465s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4591144-4a8b-4110-a354-2a4197c4b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e0d3e1-879b-423d-bf89-c555de885729', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703c6d2e-6b68-4139-8d14-3123305b821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:15 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Volume volume-d3e0d3e1-879b-423d-bf89-c555de885729 (d3e0d3e1-879b-423d-bf89-c555de885729): created successfully
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703c6d2e-6b68-4139-8d14-3123305b821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Flow 'volume_create_manager' (80e849c7-7b1f-4a07-93d1-5e9d193792ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:15 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-cb6c9ea2-2541-4171-b553-de5fb1472837 tempest-CinderUnicodeTest-35021332 None] Created volume successfully.
Sep 27 12:08:15 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Creating offline snapshot 480fb674-f5e7-4f80-8bab-dccbe239897a of volume d3e0d3e1-879b-423d-bf89-c555de885729 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d65775a-527a-46ca-bee9-e3e72b85001a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:08:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729" returned: 0 in 0.399s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:16 devstack quobyte-client[84221]: System call of process 102052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:16 devstack quobyte-client[84221]: System call of process 102052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:16 devstack quobyte-client[84221]: System call of process 102052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:16 devstack quobyte-client[84221]: System call of process 102052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:16 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=144, name=volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a 1G" returned: 0 in 0.251s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d3e0d3e1-879b-423d-bf89-c555de885729 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:16 devstack quobyte-client[84221]: System call of process 102055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:16 devstack quobyte-client[84221]: System call of process 102055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:16 devstack quobyte-client[84221]: System call of process 102055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:16 devstack quobyte-client[84221]: System call of process 102055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] CMD "qemu-img rebase -u -b volume-d3e0d3e1-879b-423d-bf89-c555de885729 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a" returned: 0 in 0.183s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a" returned: 0 in 0.080s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 12:08:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a" returned: 0 in 0.115s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.info" returned: 0 in 0.089s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 12:08:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.info" returned: 0 in 0.083s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.486s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:17 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-d418c4ce-a39e-41f0-b2b2-30b2b8bd21f9 tempest-CinderUnicodeTest-35021332 None] Create snapshot completed successfully
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Acquiring lock "cinder-480fb674-f5e7-4f80-8bab-dccbe239897a-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Lock "cinder-480fb674-f5e7-4f80-8bab-dccbe239897a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:18 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Acquiring lock "cinder-quobyte-d3e0d3e1-879b-423d-bf89-c555de885729" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Lock "cinder-quobyte-d3e0d3e1-879b-423d-bf89-c555de885729" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Acquiring lock "cinder-quobyte-480fb674-f5e7-4f80-8bab-dccbe239897a" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Lock "cinder-quobyte-480fb674-f5e7-4f80-8bab-dccbe239897a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Deleting offline snapshot 480fb674-f5e7-4f80-8bab-dccbe239897a of volume d3e0d3e1-879b-423d-bf89-c555de885729 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] snapshot_file for this snap is: volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace4883-c740-430a-8884-103464d038be]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a" returned: 0 in 0.394s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3e0d3e1-879b-423d-bf89-c555de885729(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c658ff-085b-4a90-b498-d2ce20ea383a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:08:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729" returned: 0 in 0.492s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:19 devstack quobyte-client[84221]: System call of process 102070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:19 devstack quobyte-client[84221]: System call of process 102070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a" returned: 0 in 0.386s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729.480fb674-f5e7-4f80-8bab-dccbe239897a" returned: 0 in 0.125s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:19 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Lock "cinder-quobyte-480fb674-f5e7-4f80-8bab-dccbe239897a" released by "_delete_snapshot" :: held 1.710s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:19 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Lock "cinder-quobyte-d3e0d3e1-879b-423d-bf89-c555de885729" released by "delete_snapshot" :: held 1.737s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:20 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Created reservations ['98693be1-5715-4572-b606-b7e28c194e45', 'fee54652-f1ae-45b3-b4a4-624b5e16f2a2', 'dd8fb1b2-d70f-4259-a72f-c5c05d2a2d88', '77f88ea0-684c-427d-8c70-6ce9e8d65462'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:08:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Delete snapshot completed successfully.
Sep 27 12:08:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-456b70d5-7b17-40e2-80a4-f4db72a9fdbc tempest-CinderUnicodeTest-35021332 None] Lock "cinder-480fb674-f5e7-4f80-8bab-dccbe239897a-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Acquiring lock "cinder-d3e0d3e1-879b-423d-bf89-c555de885729-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Lock "cinder-d3e0d3e1-879b-423d-bf89-c555de885729-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:21 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Acquiring lock "cinder-quobyte-d3e0d3e1-879b-423d-bf89-c555de885729" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Lock "cinder-quobyte-d3e0d3e1-879b-423d-bf89-c555de885729" acquired by "delete_volume" :: waited 0.017s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:21 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4c30ea-3cbe-4008-8ffb-ac17323e14ba]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:08:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729" returned: 0 in 0.406s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d3e0d3e1-879b-423d-bf89-c555de885729" returned: 0 in 0.103s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Lock "cinder-quobyte-d3e0d3e1-879b-423d-bf89-c555de885729" released by "delete_volume" :: held 0.678s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Created reservations ['e5d1291b-063e-47e9-8826-97b777c59b17', 'b17a0b0d-59aa-4eb1-9e1a-a639a80a28c1', '1debe7f1-ee3b-44c2-8ef3-2346e8a2a1f5', '22b9cf1c-acb5-448d-8e0c-293a39397a75'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Acquiring lock "cinder-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.354s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:22 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:08:22 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Deleted volume successfully.
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Lock "cinder-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c-delete_volume" acquired by "delete_volume" :: waited 0.278s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e70a9d37-1983-4193-883b-d2bbc99b56d8 tempest-CinderUnicodeTest-35021332 None] Lock "cinder-d3e0d3e1-879b-423d-bf89-c555de885729-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Acquiring lock "cinder-quobyte-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Lock "cinder-quobyte-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c" acquired by "delete_volume" :: waited 0.014s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4df0d6-8e5d-44a5-86d5-7d717bb3367a]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:23 devstack quobyte-client[84221]: System call of process 102110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c" returned: 0 in 0.504s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c" returned: 0 in 0.088s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Lock "cinder-quobyte-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c" released by "delete_volume" :: held 0.758s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Created reservations ['1ac68654-e639-44aa-9c19-918215442786', 'f6270726-ac90-4235-ab45-b9c6b41c61e6', '25a37675-f2df-49d2-8afe-3ca78b2d4dc0', 'c913e39c-3503-4144-b0d6-a8b75d2f9f31'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.082s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:08:24 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Deleted volume successfully.
Sep 27 12:08:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-6c8b866d-d659-4ebe-a308-944a22f1c72d tempest-CinderUnicodeTest-35021332 None] Lock "cinder-d2426b08-f942-4eb8-9ce1-e98d2dc2ec8c-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:34 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=16,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:08:34 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=20,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:08:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:08:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.167s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:08:43 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (da4f9839-6859-49b7-9709-e7b50b355070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b3b2f6-0871-4f96-acf7-897cf542ddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:43 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (a7d806f2-d032-4b11-ae00-45631e417887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45998e5-4df4-4443-9de8-cc014a21c38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45998e5-4df4-4443-9de8-cc014a21c38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1737977845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a98810-f699-4322-9ad8-6e18357f6bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:43Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9256d239-416d-4a69-9dc3-e8c86e8fa2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9256d239-416d-4a69-9dc3-e8c86e8fa2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d6033e-a226-44d7-a052-30a5da3d2f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d6033e-a226-44d7-a052-30a5da3d2f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a98810-f699-4322-9ad8-6e18357f6bc2', 'volume_name': 'volume-19a98810-f699-4322-9ad8-6e18357f6bc2', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982b8654-6d08-4754-aca0-68b6cf456a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982b8654-6d08-4754-aca0-68b6cf456a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0000e5d5-6ff4-4247-bf0d-3f6cc8e535a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:43 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume 19a98810-f699-4322-9ad8-6e18357f6bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a98810-f699-4322-9ad8-6e18357f6bc2', 'volume_size': 1}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1737977845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a98810-f699-4322-9ad8-6e18357f6bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:43Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Creating volume 19a98810-f699-4322-9ad8-6e18357f6bc2 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:43 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:43 devstack quobyte-client[84221]: System call of process 102167 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:43 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=146, name=volume-19a98810-f699-4322-9ad8-6e18357f6bc2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b3b2f6-0871-4f96-acf7-897cf542ddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1707152997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865b0f4b-e24d-47d7-b528-525ead878f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:43Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c680fe2c-eba1-4905-8786-111a33e4baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c680fe2c-eba1-4905-8786-111a33e4baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bd0613-d704-4bef-a4ae-e08cb8f96172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bd0613-d704-4bef-a4ae-e08cb8f96172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865b0f4b-e24d-47d7-b528-525ead878f6e', 'volume_name': 'volume-865b0f4b-e24d-47d7-b528-525ead878f6e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d042a3-e8b9-460d-90d1-2921d58f4c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d042a3-e8b9-460d-90d1-2921d58f4c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de72a042-12f6-4dc3-8b6c-c239fb81f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:44 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Volume 865b0f4b-e24d-47d7-b528-525ead878f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865b0f4b-e24d-47d7-b528-525ead878f6e', 'volume_size': 1}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:44 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (bf61f924-f544-472d-90cb-5cfb66d60fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdc1be1-112d-4039-b8eb-9dbbcc43bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 1073741824" returned: 0 in 0.969s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdc1be1-112d-4039-b8eb-9dbbcc43bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1603739227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a1bd25-1f74-4120-8636-6a15380ba1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:43Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38c98e3-cfca-407a-af87-4b3514478151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38c98e3-cfca-407a-af87-4b3514478151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6834c85-8578-4266-bf02-565dc45179d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6834c85-8578-4266-bf02-565dc45179d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a1bd25-1f74-4120-8636-6a15380ba1f0', 'volume_name': 'volume-25a1bd25-1f74-4120-8636-6a15380ba1f0', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d819884-057f-472e-a7e3-7600e1dae5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d819884-057f-472e-a7e3-7600e1dae5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce07e375-2384-4923-8358-cd74d8445bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Volume 25a1bd25-1f74-4120-8636-6a15380ba1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a1bd25-1f74-4120-8636-6a15380ba1f0', 'volume_size': 1}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (3be6167e-1680-4b90-ac96-fed2ce6e6426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4243aae2-7d2b-4775-a180-515c65922099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2" returned: 0 in 0.608s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] <== create_volume: return (1617ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (f417e6d4-08fa-4498-9699-c720b0039b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed2f45b-6656-4acf-826e-b2aae2943de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.977s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1707152997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865b0f4b-e24d-47d7-b528-525ead878f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:43Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Creating volume 865b0f4b-e24d-47d7-b528-525ead878f6e {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:45 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-865b0f4b-e24d-47d7-b528-525ead878f6e 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:45 devstack quobyte-client[84221]: System call of process 102171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:45 devstack quobyte-client[84221]: System call of process 102171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:45 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=147, name=volume-865b0f4b-e24d-47d7-b528-525ead878f6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed2f45b-6656-4acf-826e-b2aae2943de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-617948819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70cc13b5-6fa9-46d9-b76b-7d600c66929d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:44Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2682db-e8d9-4015-bc52-c93d499d22b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2682db-e8d9-4015-bc52-c93d499d22b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3bdf59-1259-4b08-b23b-e52fc8e0cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3bdf59-1259-4b08-b23b-e52fc8e0cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70cc13b5-6fa9-46d9-b76b-7d600c66929d', 'volume_name': 'volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7477c6c2-ada0-4f71-899e-8923beb2cc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7477c6c2-ada0-4f71-899e-8923beb2cc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56569523-6427-442b-9007-dd0a93b922b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Volume 70cc13b5-6fa9-46d9-b76b-7d600c66929d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d', 'volume_size': 1}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0000e5d5-6ff4-4247-bf0d-3f6cc8e535a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a98810-f699-4322-9ad8-6e18357f6bc2', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58874d08-2524-429e-9046-04982c946094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4243aae2-7d2b-4775-a180-515c65922099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-719680995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388b861f-f1b4-4a74-ae4e-7ed868ceb27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:44Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e87586-13fe-4918-a839-ccfa171b1640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e87586-13fe-4918-a839-ccfa171b1640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec505387-1154-4345-a9d3-c935e8df764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec505387-1154-4345-a9d3-c935e8df764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388b861f-f1b4-4a74-ae4e-7ed868ceb27d', 'volume_name': 'volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccb0a0d-4fa7-4b57-909c-ff031a98dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccb0a0d-4fa7-4b57-909c-ff031a98dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5d98a9-fcf6-442e-b368-f7d9636c8c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Volume 388b861f-f1b4-4a74-ae4e-7ed868ceb27d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d', 'volume_size': 1}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume volume-19a98810-f699-4322-9ad8-6e18357f6bc2 (19a98810-f699-4322-9ad8-6e18357f6bc2): created successfully
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58874d08-2524-429e-9046-04982c946094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (a7d806f2-d032-4b11-ae00-45631e417887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:45 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (af26e390-11cf-4ece-8205-7e067ac097ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f52432e-8a9b-437b-95ac-e410f94e7956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-865b0f4b-e24d-47d7-b528-525ead878f6e 1073741824" returned: 0 in 0.740s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:45 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-489cf739-e536-40d7-9d12-b7d70bf7e6da tempest-CreateVolumesFromSnapshotTest-326605136 None] Created volume successfully.
Sep 27 12:08:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-865b0f4b-e24d-47d7-b528-525ead878f6e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:46 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Flow 'volume_create_manager' (e8c23999-87ea-4c90-b326-1abd7b741c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b170113e-0f54-4437-a079-5ccdea1788bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f52432e-8a9b-437b-95ac-e410f94e7956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3517856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e54e4bd-6c96-4825-90a9-7907ea4504c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:45Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba53c5c9-c1af-4d49-a1c1-0d8beb784126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba53c5c9-c1af-4d49-a1c1-0d8beb784126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2c974d-0df4-4344-b4cc-4f24343bca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2c974d-0df4-4344-b4cc-4f24343bca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e54e4bd-6c96-4825-90a9-7907ea4504c1', 'volume_name': 'volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739b58cd-afdc-4257-a1f9-308af2e49aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739b58cd-afdc-4257-a1f9-308af2e49aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9433c5d-daba-4aa3-9c5d-ad84ec0c28cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:46 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Volume 6e54e4bd-6c96-4825-90a9-7907ea4504c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1', 'volume_size': 1}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-865b0f4b-e24d-47d7-b528-525ead878f6e" returned: 0 in 0.575s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] <== create_volume: return (1362ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1603739227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a1bd25-1f74-4120-8636-6a15380ba1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:43Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Creating volume 25a1bd25-1f74-4120-8636-6a15380ba1f0 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:46 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-25a1bd25-1f74-4120-8636-6a15380ba1f0 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:46 devstack quobyte-client[84221]: System call of process 102175 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:46 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=148, name=volume-25a1bd25-1f74-4120-8636-6a15380ba1f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de72a042-12f6-4dc3-8b6c-c239fb81f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865b0f4b-e24d-47d7-b528-525ead878f6e', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ec8869-a115-4a6c-9b15-f175a1711752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b170113e-0f54-4437-a079-5ccdea1788bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6986918-d3cc-4a50-a751-12962f7fffca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f6731160604866903bcf9760c98b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:46Z,use_quota=True,user_id='d8f024f62d6443958cd2d38a5887aaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68433e54-3e1b-4d2d-a3cf-fb19021ca29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68433e54-3e1b-4d2d-a3cf-fb19021ca29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6b0a15-08fa-4f7c-bb1e-5a6affff13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.image.glance [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Creating Keystone auth plugin from conf {{(pid=84197) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 27 12:08:47 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Volume volume-865b0f4b-e24d-47d7-b528-525ead878f6e (865b0f4b-e24d-47d7-b528-525ead878f6e): created successfully
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ec8869-a115-4a6c-9b15-f175a1711752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (da4f9839-6859-49b7-9709-e7b50b355070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:47 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-25a1bd25-1f74-4120-8636-6a15380ba1f0 1073741824" returned: 0 in 0.606s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-25a1bd25-1f74-4120-8636-6a15380ba1f0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:47 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-5b92d036-695d-4779-a897-6ad195b083e7 tempest-CreateVolumesFromImageTest-650751598 None] Created volume successfully.
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-25a1bd25-1f74-4120-8636-6a15380ba1f0" returned: 0 in 0.322s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] <== create_volume: return (951ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.855s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-617948819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70cc13b5-6fa9-46d9-b76b-7d600c66929d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:44Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Creating volume 70cc13b5-6fa9-46d9-b76b-7d600c66929d {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:47 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:47 devstack quobyte-client[84221]: System call of process 102180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:47 devstack quobyte-client[84221]: System call of process 102180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:47 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=149, name=volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:47 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce07e375-2384-4923-8358-cd74d8445bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a1bd25-1f74-4120-8636-6a15380ba1f0', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cadcd25-baa0-470b-9974-8b732ef5e514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d 1073741824" returned: 0 in 0.492s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:48 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Volume volume-25a1bd25-1f74-4120-8636-6a15380ba1f0 (25a1bd25-1f74-4120-8636-6a15380ba1f0): created successfully
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cadcd25-baa0-470b-9974-8b732ef5e514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (bf61f924-f544-472d-90cb-5cfb66d60fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6b0a15-08fa-4f7c-bb1e-5a6affff13ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6986918-d3cc-4a50-a751-12962f7fffca', 'volume_name': 'volume-f6986918-d3cc-4a50-a751-12962f7fffca', 'volume_size': 1, 'image_id': '158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e46586003027e9204528d073c7a994d7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51f6731160604866903bcf9760c98b50', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63a017e8d3995f5957a6d3bc76c663b5b62d346d4a6f1bb9506c8dc29747a6985530a067ccdddccfe500bc22895ef7d0e75ef47ade6fc3ad2a4c3f61a05018ed', 'id': '158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'created_at': datetime.datetime(2025, 9, 27, 10, 8, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 10, 8, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/158dc519-8c01-4a9b-8f19-dbc2d44881ce/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce52bdfc40>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64730606-a4e6-4784-9615-2014ff2ecbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64730606-a4e6-4784-9615-2014ff2ecbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f5006d-6634-449b-a737-45ab03d17241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:48 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Volume f6986918-d3cc-4a50-a751-12962f7fffca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6986918-d3cc-4a50-a751-12962f7fffca', 'volume_size': 1, 'image_id': '158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e46586003027e9204528d073c7a994d7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51f6731160604866903bcf9760c98b50', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63a017e8d3995f5957a6d3bc76c663b5b62d346d4a6f1bb9506c8dc29747a6985530a067ccdddccfe500bc22895ef7d0e75ef47ade6fc3ad2a4c3f61a05018ed', 'id': '158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'created_at': datetime.datetime(2025, 9, 27, 10, 8, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 10, 8, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/158dc519-8c01-4a9b-8f19-dbc2d44881ce/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce52bdfc40>}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Cloning f6986918-d3cc-4a50-a751-12962f7fffca from image 158dc519-8c01-4a9b-8f19-dbc2d44881ce  at location (None, [{'url': 'file:///opt/stack/data/glance/images/158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'metadata': {}}]). {{(pid=84197) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d" returned: 0 in 0.441s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] <== create_volume: return (965ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.753s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-719680995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388b861f-f1b4-4a74-ae4e-7ed868ceb27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:44Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Creating volume 388b861f-f1b4-4a74-ae4e-7ed868ceb27d {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:48 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:48 devstack quobyte-client[84221]: System call of process 102184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:48 devstack quobyte-client[84221]: System call of process 102184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:48 devstack quobyte-client[84221]: System call of process 102184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:48 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=150, name=volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:48 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-2cb1a843-e578-46bf-b1f5-229b0b378808 tempest-CreateVolumesFromImageTest-650751598 None] Created volume successfully.
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56569523-6427-442b-9007-dd0a93b922b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5c8356-cd15-469a-80cc-3b2918947c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 27 12:08:49 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Image download 0.00 MB at 0.00 MB/s
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d 1073741824" returned: 0 in 0.471s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:49 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Volume volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d (70cc13b5-6fa9-46d9-b76b-7d600c66929d): created successfully
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5c8356-cd15-469a-80cc-3b2918947c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (f417e6d4-08fa-4498-9699-c720b0039b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d" returned: 0 in 0.413s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] <== create_volume: return (905ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b90d7c-5204-4472-a392-b33cf108ef68]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3517856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e54e4bd-6c96-4825-90a9-7907ea4504c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d960f4f109547f38ee728a436b16759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:45Z,use_quota=True,user_id='39356d46e9474f808b66719c6d3f7df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Creating volume 6e54e4bd-6c96-4825-90a9-7907ea4504c1 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:49 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:49 devstack quobyte-client[84221]: System call of process 102188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:49 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-2ec1a3e0-364b-470c-8c2c-90c8c421c9f2 tempest-CreateVolumesFromImageTest-650751598 None] Created volume successfully.
Sep 27 12:08:49 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=151, name=volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5d98a9-fcf6-442e-b368-f7d9636c8c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45736046-824b-4083-9bf0-e33d6532a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1 1073741824" returned: 0 in 0.637s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:50 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD
Sep 27 12:08:50 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Volume volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d (388b861f-f1b4-4a74-ae4e-7ed868ceb27d): created successfully
Sep 27 12:08:50 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45736046-824b-4083-9bf0-e33d6532a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (3be6167e-1680-4b90-ac96-fed2ce6e6426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1" returned: 0 in 0.446s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] <== create_volume: return (1110ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.465s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:50 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-90511102-8bf9-4066-90a6-9a1c7eb42c28 tempest-CreateVolumesFromImageTest-650751598 None] Created volume successfully.
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9433c5d-daba-4aa3-9c5d-ad84ec0c28cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae139875-59c9-427e-b57f-1f1600dcff2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Creating offline snapshot a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d of volume 19a98810-f699-4322-9ad8-6e18357f6bc2 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 12:08:50 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Volume volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1 (6e54e4bd-6c96-4825-90a9-7907ea4504c1): created successfully
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae139875-59c9-427e-b57f-1f1600dcff2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Flow 'volume_create_manager' (af26e390-11cf-4ece-8205-7e067ac097ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aefe85-29f6-49a5-8edb-4b31572b8b3f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:08:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:51 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-9ee8187e-09ba-4a31-8d23-dac49a7ddc9e tempest-CreateVolumesFromImageTest-650751598 None] Created volume successfully.
Sep 27 12:08:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2" returned: 0 in 0.584s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:51 devstack quobyte-client[84221]: System call of process 102197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:51 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=152, name=volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d 1G" returned: 0 in 0.352s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): qemu-img rebase -u -b volume-19a98810-f699-4322-9ad8-6e18357f6bc2 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:52 devstack quobyte-client[84221]: System call of process 102202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:52 devstack quobyte-client[84221]: System call of process 102202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:52 devstack quobyte-client[84221]: System call of process 102202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-6e54e4bd-6c96-4825-90a9-7907ea4504c1-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "qemu-img rebase -u -b volume-19a98810-f699-4322-9ad8-6e18357f6bc2 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d" returned: 0 in 0.483s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 12:08:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-6e54e4bd-6c96-4825-90a9-7907ea4504c1-delete_volume" acquired by "delete_volume" :: waited 0.332s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:52 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Sep 27 12:08:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD" returned: 0 in 3.023s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d" returned: 0 in 0.533s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:53 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:53 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-quobyte-6e54e4bd-6c96-4825-90a9-7907ea4504c1" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:53 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d" returned: 0 in 0.266s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.info" returned: 0 in 0.167s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-6e54e4bd-6c96-4825-90a9-7907ea4504c1" acquired by "delete_volume" :: waited 0.408s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef4371-613e-44ff-90df-ce3b9d41ce56]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.info" returned: 0 in 0.300s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.394s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:54 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-39a39299-19e0-4e75-b8ca-ab76bb0ecf7b tempest-CreateVolumesFromSnapshotTest-326605136 None] Create snapshot completed successfully
Sep 27 12:08:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1" returned: 0 in 0.661s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6e54e4bd-6c96-4825-90a9-7907ea4504c1" returned: 0 in 0.115s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:54 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-6e54e4bd-6c96-4825-90a9-7907ea4504c1" released by "delete_volume" :: held 1.049s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Created reservations ['8d2ed62c-5433-4da4-a350-d74c99781346', '4a4ed621-05fe-400f-9ad4-77cb45d73f9f', '241d6ff7-a4cb-4b60-9195-8a22ff3241a1', '3f1669f0-7c9f-4b16-9cee-28257a1798f9'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:08:55 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (56167347-ebf2-4023-8ca1-469ed81ad3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0ce580-e79f-4f03-bace-a78d419b5012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:56 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0ce580-e79f-4f03-bace-a78d419b5012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139332989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5326f869-7862-4893-b9a7-e3490b68ebf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:56Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978838ef-2c09-4fdc-875e-933ff3c34ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978838ef-2c09-4fdc-875e-933ff3c34ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cd2410-9baf-412d-8743-38c49cab3a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cd2410-9baf-412d-8743-38c49cab3a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5326f869-7862-4893-b9a7-e3490b68ebf7', 'volume_name': 'volume-5326f869-7862-4893-b9a7-e3490b68ebf7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd04a5c-dd9a-421c-8bf6-4c7032f40900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd04a5c-dd9a-421c-8bf6-4c7032f40900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa4c53e-ff6b-4a44-933d-ba29694499e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:56 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume 5326f869-7862-4893-b9a7-e3490b68ebf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5326f869-7862-4893-b9a7-e3490b68ebf7', 'volume_size': 1}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139332989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5326f869-7862-4893-b9a7-e3490b68ebf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:56Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Creating volume 5326f869-7862-4893-b9a7-e3490b68ebf7 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:56 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5326f869-7862-4893-b9a7-e3490b68ebf7 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD" returned: 1 in 3.736s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 12:08:56 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Temporary image 158dc519-8c01-4a9b-8f19-dbc2d44881ce is fetched for user d8f024f62d6443958cd2d38a5887aaa7. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 27 12:08:56 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=154, name=volume-5326f869-7862-4893-b9a7-e3490b68ebf7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-70cc13b5-6fa9-46d9-b76b-7d600c66929d-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 1.212s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:08:57 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Deleted volume successfully.
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5326f869-7862-4893-b9a7-e3490b68ebf7 1073741824" returned: 0 in 0.687s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5326f869-7862-4893-b9a7-e3490b68ebf7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-70cc13b5-6fa9-46d9-b76b-7d600c66929d-delete_volume" acquired by "delete_volume" :: waited 0.318s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5326f869-7862-4893-b9a7-e3490b68ebf7" returned: 0 in 0.335s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] <== create_volume: return (1048ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:57 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (7d0e58ce-0860-4c95-aad4-36364da03698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c595d97b-c426-4312-a463-e35166dbd30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:57 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (c2a4990d-cc3c-4443-936a-241b9f231693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9184d36-0c4d-4eab-b5fb-1446f275348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:57 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (d8be2509-c0ad-43f7-a7c5-af9762017a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2da984-d184-4e3f-9e2c-857b71c5fc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2da984-d184-4e3f-9e2c-857b71c5fc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1574315765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:57Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b670cd-339f-4b04-a81e-a79f50b3fa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b670cd-339f-4b04-a81e-a79f50b3fa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe1ad58-231e-4e46-b012-938a3841d957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe1ad58-231e-4e46-b012-938a3841d957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651', 'volume_name': 'volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe80c79-ebed-4ede-b4c3-73605597946f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe80c79-ebed-4ede-b4c3-73605597946f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2bdd72-e6bd-45ba-a1f5-2e2e483e1085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:57 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume 0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651', 'volume_size': 1}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1574315765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:57Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Creating volume 0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:57 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:58 devstack quobyte-client[84221]: System call of process 102225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:58 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=155, name=volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-4d5bab59-3179-4fe7-8621-e89060385c05 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-6e54e4bd-6c96-4825-90a9-7907ea4504c1-delete_volume" released by "delete_volume" :: held 5.801s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa4c53e-ff6b-4a44-933d-ba29694499e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5326f869-7862-4893-b9a7-e3490b68ebf7', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a41a916-858d-4596-97e6-a9f51eb10a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9184d36-0c4d-4eab-b5fb-1446f275348b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15900827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3ea0df-81a2-4f49-b28b-3107e7f62940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:56Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdb0868-046f-4132-96a7-cd3407566b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdb0868-046f-4132-96a7-cd3407566b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8677294-1b47-4ffd-af46-8de51242a9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8677294-1b47-4ffd-af46-8de51242a9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3ea0df-81a2-4f49-b28b-3107e7f62940', 'volume_name': 'volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b66c13-bef7-4146-b721-13d807f17258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b66c13-bef7-4146-b721-13d807f17258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e9a5f4-6355-4e85-836b-89ae78548b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:58 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume 5d3ea0df-81a2-4f49-b28b-3107e7f62940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940', 'volume_size': 1}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c595d97b-c426-4312-a463-e35166dbd30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115329329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:56Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c17adcb-8e4f-4b23-a516-0b611be811f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c17adcb-8e4f-4b23-a516-0b611be811f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a82783-274c-4527-af60-0d03473c66a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a82783-274c-4527-af60-0d03473c66a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8', 'volume_name': 'volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf7a66e-6b01-435a-8015-c0b1299ec6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf7a66e-6b01-435a-8015-c0b1299ec6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894589a4-9223-4b74-96c1-b9d5dcd13d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:58 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume 6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8', 'volume_size': 1}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3ef9d0-d9b8-4610-960c-9ab4a5ba5e64]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:08:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:59 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume volume-5326f869-7862-4893-b9a7-e3490b68ebf7 (5326f869-7862-4893-b9a7-e3490b68ebf7): created successfully
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a41a916-858d-4596-97e6-a9f51eb10a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (56167347-ebf2-4023-8ca1-469ed81ad3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:59 devstack sudo[102230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651 1073741824" returned: 0 in 1.136s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:59 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 12:08:59 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (43a5ce56-0fa9-45dc-87ae-b2cb858e4cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb90153-692c-4d3f-bc93-cade99ea96fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:59 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-quobyte-70cc13b5-6fa9-46d9-b76b-7d600c66929d" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:08:59 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-77539360-61b6-4cec-b45e-302151eda50a tempest-CreateVolumesFromSnapshotTest-326605136 None] Created volume successfully.
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eb90153-692c-4d3f-bc93-cade99ea96fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087906174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea2d71d-ecc4-48d4-902c-61c942f5337a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:58Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d2541b-9ca1-469e-9a19-b010566011d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d2541b-9ca1-469e-9a19-b010566011d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bec5b4-d01c-44c9-8f0f-d93a2a1c7636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bec5b4-d01c-44c9-8f0f-d93a2a1c7636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea2d71d-ecc4-48d4-902c-61c942f5337a', 'volume_name': 'volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbf0cbc-f865-4a8d-9d5b-6484a72fee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbf0cbc-f865-4a8d-9d5b-6484a72fee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201a573f-52a0-4d8e-90f7-4a4b4f9586e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:08:59 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume 0ea2d71d-ecc4-48d4-902c-61c942f5337a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a', 'volume_size': 1}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651" returned: 0 in 0.574s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] <== create_volume: return (1824ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15900827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3ea0df-81a2-4f49-b28b-3107e7f62940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:56Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Creating volume 5d3ea0df-81a2-4f49-b28b-3107e7f62940 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:08:59 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:08:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:08:59 devstack quobyte-client[84221]: System call of process 102233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:08:59 devstack quobyte-client[84221]: System call of process 102233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:00 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=156, name=volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-70cc13b5-6fa9-46d9-b76b-7d600c66929d" acquired by "delete_volume" :: waited 0.422s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:00 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d79fc0c-56fa-4443-b52d-45a90720981b]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2bdd72-e6bd-45ba-a1f5-2e2e483e1085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed2047-e189-470f-9afc-13bf78449c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940 1073741824" returned: 0 in 0.925s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:00 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651 (0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651): created successfully
Sep 27 12:09:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed2047-e189-470f-9afc-13bf78449c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (d8be2509-c0ad-43f7-a7c5-af9762017a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:01 devstack quobyte-client[84221]: System call of process 102236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:01 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f0e8316b-e2b2-4917-8976-f66fb36a9b31 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created volume successfully.
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940" returned: 0 in 0.508s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] <== create_volume: return (1499ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.732s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115329329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:56Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Creating volume 6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:01 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:01 devstack quobyte-client[84221]: System call of process 102242 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:01 devstack quobyte-client[84221]: System call of process 102242 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:01 devstack quobyte-client[84221]: System call of process 102242 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:01 devstack quobyte-client[84221]: System call of process 102242 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:01 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=157, name=volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:01 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d" returned: 0 in 1.439s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:01 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e9a5f4-6355-4e85-836b-89ae78548b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dda14fc-6238-4392-80c1-1fd190735763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD" returned: 0 in 3.481s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:02 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940 (5d3ea0df-81a2-4f49-b28b-3107e7f62940): created successfully
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dda14fc-6238-4392-80c1-1fd190735763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (c2a4990d-cc3c-4443-936a-241b9f231693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8 1073741824" returned: 0 in 1.161s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-70cc13b5-6fa9-46d9-b76b-7d600c66929d" returned: 0 in 0.810s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:02 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8b889d82-22b8-4931-928d-23f5552cdaa1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created volume successfully.
Sep 27 12:09:02 devstack sudo[102246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD
Sep 27 12:09:02 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8" returned: 0 in 0.355s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] <== create_volume: return (1609ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-70cc13b5-6fa9-46d9-b76b-7d600c66929d" released by "delete_volume" :: held 2.960s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.263s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087906174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea2d71d-ecc4-48d4-902c-61c942f5337a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a68fbabd17455caa5eeb872be42ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:58Z,use_quota=True,user_id='a8f7c7099ded4e139f4593d0c6d7be08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Creating volume 0ea2d71d-ecc4-48d4-902c-61c942f5337a {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:03 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:03 devstack quobyte-client[84221]: System call of process 102249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:03 devstack quobyte-client[84221]: System call of process 102249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:03 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=158, name=volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894589a4-9223-4b74-96c1-b9d5dcd13d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7aa2ff-e5bd-4a9d-8da7-99579b5a5ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a 1073741824" returned: 0 in 0.615s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:03 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8 (6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8): created successfully
Sep 27 12:09:03 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7aa2ff-e5bd-4a9d-8da7-99579b5a5ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (7d0e58ce-0860-4c95-aad4-36364da03698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a" returned: 0 in 0.488s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] <== create_volume: return (1139ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Created reservations ['10059ad8-9b59-4fa7-9f02-7e3e66e34339', '660a6a44-f59e-4860-ae0a-28901d86bb3b', '403ab323-49ab-47e3-a442-3079aada419c', 'b3b12930-47d3-4160-bcdc-11d6e3386409'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201a573f-52a0-4d8e-90f7-4a4b4f9586e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3ebbee-a45e-48de-890c-374baf7f3a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-6370ca8c-4098-485f-86f9-f8762457df52 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created volume successfully.
Sep 27 12:09:04 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a (0ea2d71d-ecc4-48d4-902c-61c942f5337a): created successfully
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3ebbee-a45e-48de-890c-374baf7f3a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Flow 'volume_create_manager' (43a5ce56-0fa9-45dc-87ae-b2cb858e4cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:04 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-491c3e93-b63a-417b-beee-1f6bbdce69da tempest-CreateVolumesFromSnapshotTest-326605136 None] Created volume successfully.
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:04 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-388b861f-f1b4-4a74-ae4e-7ed868ceb27d-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.655s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-388b861f-f1b4-4a74-ae4e-7ed868ceb27d-delete_volume" acquired by "delete_volume" :: waited 0.204s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:05 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Deleted volume successfully.
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-0ea2d71d-ecc4-48d4-902c-61c942f5337a-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:05 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD" returned: 1 in 3.209s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6986918-d3cc-4a50-a751-12962f7fffca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f6731160604866903bcf9760c98b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:08:46Z,use_quota=True,user_id='d8f024f62d6443958cd2d38a5887aaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Creating volume f6986918-d3cc-4a50-a751-12962f7fffca {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:05 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-0ea2d71d-ecc4-48d4-902c-61c942f5337a-delete_volume" acquired by "delete_volume" :: waited 0.215s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:05 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=159, name=volume-f6986918-d3cc-4a50-a751-12962f7fffca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-5637ac10-a55c-4972-9e51-92c785f8e47e tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-70cc13b5-6fa9-46d9-b76b-7d600c66929d-delete_volume" released by "delete_volume" :: held 8.505s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:05 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-quobyte-0ea2d71d-ecc4-48d4-902c-61c942f5337a" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:05 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-quobyte-388b861f-f1b4-4a74-ae4e-7ed868ceb27d" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca 1073741824" returned: 0 in 0.558s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca" returned: 0 in 0.186s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] <== create_volume: return (779ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-388b861f-f1b4-4a74-ae4e-7ed868ceb27d" acquired by "delete_volume" :: waited 0.336s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-0ea2d71d-ecc4-48d4-902c-61c942f5337a" acquired by "delete_volume" :: waited 0.382s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2666eac7-5d01-49a1-a74c-23a0af52c519]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d5d221-a4a3-4506-832e-5bfaac71fb3f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Attempting download of 158dc519-8c01-4a9b-8f19-dbc2d44881ce ((None, [{'url': 'file:///opt/stack/data/glance/images/158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'metadata': {}}])) to volume f6986918-d3cc-4a50-a751-12962f7fffca. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6014e5-19b0-4217-97da-2a4b8ad21702]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_158dc519-8c01-4a9b-8f19-dbc2d44881ce_twe87dgu {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:06 devstack quobyte-client[84221]: System call of process 102261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:07 devstack quobyte-client[84221]: System call of process 102262 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d" returned: 0 in 0.790s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a" returned: 0 in 0.749s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-388b861f-f1b4-4a74-ae4e-7ed868ceb27d" returned: 0 in 0.201s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-388b861f-f1b4-4a74-ae4e-7ed868ceb27d" released by "delete_volume" :: held 1.251s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0ea2d71d-ecc4-48d4-902c-61c942f5337a" returned: 0 in 0.386s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_158dc519-8c01-4a9b-8f19-dbc2d44881ce_twe87dgu" returned: 0 in 0.811s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_158dc519-8c01-4a9b-8f19-dbc2d44881ce_twe87dgu {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:07 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-0ea2d71d-ecc4-48d4-902c-61c942f5337a" released by "delete_volume" :: held 1.547s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created reservations ['e5f383db-035f-4168-be6e-72a273ac19c2', '7636f278-2aab-4a45-a42e-e6134f94c7f9', 'b078dc6b-599d-4d5e-b3c4-810fd2a566f6', '2fac1f3f-10bb-4b70-8cdf-cc86f95b74d2'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_158dc519-8c01-4a9b-8f19-dbc2d44881ce_twe87dgu" returned: 1 in 0.535s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_158dc519-8c01-4a9b-8f19-dbc2d44881ce_twe87dgu' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Created reservations ['6609852a-2a9e-48da-9cac-9d2198886d6a', '1e7541be-7c9c-478a-a26f-68016a59a75d', '771b6e9d-fecd-4481-ac9f-4ad64af6533c', '40d53fc1-d43c-436e-8d74-b7269d109e7f'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef2440b-50ca-4a12-b058-ab065e64bcc7]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.455s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:09 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Deleted volume successfully.
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-25a1bd25-1f74-4120-8636-6a15380ba1f0-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ae374e5e-7144-40f1-87f3-ce2e2dffdcc0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-0ea2d71d-ecc4-48d4-902c-61c942f5337a-delete_volume" released by "delete_volume" :: held 4.378s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD" returned: 1 in 0.876s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] 158dc519-8c01-4a9b-8f19-dbc2d44881ce was raw, converting to raw {{(pid=84197) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 27 12:09:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.464s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:10 devstack quobyte-client[84221]: System call of process 102281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:10 devstack quobyte-client[84221]: System call of process 102281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:10 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=159, name=volume-f6986918-d3cc-4a50-a751-12962f7fffca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651-delete_volume" acquired by "delete_volume" :: waited 0.297s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-25a1bd25-1f74-4120-8636-6a15380ba1f0-delete_volume" acquired by "delete_volume" :: waited 0.580s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Deleted volume successfully.
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca" returned: 0 in 0.418s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_158dc519-8c01-4a9b-8f19-dbc2d44881ce_e0_z7bzadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 12:09:10 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Converted 0.00 MB image at 0.00 MB/s
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-423bb9ae-cda6-4c98-8403-72dfccd4ca30 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-388b861f-f1b4-4a74-ae4e-7ed868ceb27d-delete_volume" released by "delete_volume" :: held 5.642s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca 1G" returned: 0 in 0.485s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-quobyte-25a1bd25-1f74-4120-8636-6a15380ba1f0" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-quobyte-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-25a1bd25-1f74-4120-8636-6a15380ba1f0" acquired by "delete_volume" :: waited 0.055s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651" acquired by "delete_volume" :: waited 0.065s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[7050f370-ca62-4c4e-b4a7-9f154a3f016f]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc189657-5d82-472b-82bb-bc9cc50f0200]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[778a6b47-c50c-45ab-93d2-ebe8bdf0a013]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-25a1bd25-1f74-4120-8636-6a15380ba1f0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:11 devstack quobyte-client[84221]: System call of process 102294 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca" returned: 0 in 0.541s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:11 devstack quobyte-client[84221]: System call of process 102295 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-25a1bd25-1f74-4120-8636-6a15380ba1f0" returned: 0 in 0.655s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-25a1bd25-1f74-4120-8636-6a15380ba1f0 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:11 devstack quobyte-client[84221]: System call of process 102296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:11 devstack quobyte-client[84221]: System call of process 102296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651" returned: 0 in 0.810s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-25a1bd25-1f74-4120-8636-6a15380ba1f0" returned: 0 in 0.279s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:12 devstack quobyte-client[84221]: System call of process 102298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-25a1bd25-1f74-4120-8636-6a15380ba1f0" released by "delete_volume" :: held 1.299s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca" returned: 1 in 0.797s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651" returned: 0 in 0.345s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Downloaded image 158dc519-8c01-4a9b-8f19-dbc2d44881ce ((None, [{'url': 'file:///opt/stack/data/glance/images/158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'metadata': {}}])) to volume f6986918-d3cc-4a50-a751-12962f7fffca successfully. {{(pid=84197) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Temporary image 158dc519-8c01-4a9b-8f19-dbc2d44881ce for user d8f024f62d6443958cd2d38a5887aaa7 is deleted. {{(pid=84197) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.volume.volume_utils [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Marking volume f6986918-d3cc-4a50-a751-12962f7fffca as bootable. {{(pid=84197) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Copying metadata from image 158dc519-8c01-4a9b-8f19-dbc2d44881ce to f6986918-d3cc-4a50-a751-12962f7fffca. {{(pid=84197) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Creating volume glance metadata for volume f6986918-d3cc-4a50-a751-12962f7fffca backed by image 158dc519-8c01-4a9b-8f19-dbc2d44881ce with: {'image_id': '158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e46586003027e9204528d073c7a994d7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84197) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651" released by "delete_volume" :: held 1.522s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Created reservations ['74ffca32-4ab0-498d-80dd-afc7652095fe', 'ff9e1c95-0fe0-40f1-9d4a-0c401553d40d', '315e543d-9f99-4b19-a143-abb478958d6e', '1482a47c-ba04-4cbb-b1a7-1afa158cb471'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created reservations ['e93d10d6-c5de-489c-8eac-2cf2c3202243', '2735d1b2-ad24-42b2-99a0-da8207bfa88c', '3ae21503-967d-4a45-968a-5035086fc190', 'a5a5c7fb-fe52-4bb3-abe3-410b22d592c0'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f5006d-6634-449b-a737-45ab03d17241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6986918-d3cc-4a50-a751-12962f7fffca', 'volume_size': 1, 'image_id': '158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e46586003027e9204528d073c7a994d7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51f6731160604866903bcf9760c98b50', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63a017e8d3995f5957a6d3bc76c663b5b62d346d4a6f1bb9506c8dc29747a6985530a067ccdddccfe500bc22895ef7d0e75ef47ade6fc3ad2a4c3f61a05018ed', 'id': '158dc519-8c01-4a9b-8f19-dbc2d44881ce', 'created_at': datetime.datetime(2025, 9, 27, 10, 8, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 27, 10, 8, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/158dc519-8c01-4a9b-8f19-dbc2d44881ce/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fce52bdfc40>}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a3d9b0-0a0f-471c-9570-82677ba958d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-865b0f4b-e24d-47d7-b528-525ead878f6e-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:13 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Volume volume-f6986918-d3cc-4a50-a751-12962f7fffca (f6986918-d3cc-4a50-a751-12962f7fffca): created successfully
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a3d9b0-0a0f-471c-9570-82677ba958d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Flow 'volume_create_manager' (e8c23999-87ea-4c90-b326-1abd7b741c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.829s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-865b0f4b-e24d-47d7-b528-525ead878f6e-delete_volume" acquired by "delete_volume" :: waited 0.412s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:13 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-135f0502-14c6-48c0-b930-436e66b602af tempest-VolumeImageDependencyTests-402681674 None] Created volume successfully.
Sep 27 12:09:14 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Deleted volume successfully.
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Acquiring lock "cinder-f6986918-d3cc-4a50-a751-12962f7fffca-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.548s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-0fcc4542-5e04-48dd-b82f-5819456134c6 tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-25a1bd25-1f74-4120-8636-6a15380ba1f0-delete_volume" released by "delete_volume" :: held 3.933s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Lock "cinder-f6986918-d3cc-4a50-a751-12962f7fffca-delete_volume" acquired by "delete_volume" :: waited 0.180s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-quobyte-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:14 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Deleted volume successfully.
Sep 27 12:09:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "cinder-quobyte-865b0f4b-e24d-47d7-b528-525ead878f6e" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8" acquired by "delete_volume" :: waited 0.047s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4cf6c6-413f-4975-ad70-9828fe1f7d19]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:14 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Acquiring lock "cinder-quobyte-f6986918-d3cc-4a50-a751-12962f7fffca" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-034ea715-9a4d-457c-b1ea-ec4cce85b6c1 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-0b1cb76e-e9fd-4cbd-8f47-ca2aa6dab651-delete_volume" released by "delete_volume" :: held 4.416s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-865b0f4b-e24d-47d7-b528-525ead878f6e" acquired by "delete_volume" :: waited 0.337s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Lock "cinder-quobyte-f6986918-d3cc-4a50-a751-12962f7fffca" acquired by "delete_volume" :: waited 0.326s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03dfb7-66d0-4d3e-bce2-98c65035e0f2]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-865b0f4b-e24d-47d7-b528-525ead878f6e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5b4dea-9d43-48d9-bd12-d539bae45ac5]: (4, 'raw') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:14 devstack quobyte-client[84221]: System call of process 102309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:14 devstack quobyte-client[84221]: System call of process 102309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8" returned: 0 in 0.696s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8" returned: 0 in 0.129s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:15 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8" released by "delete_volume" :: held 1.132s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:15 devstack quobyte-client[84221]: System call of process 102311 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca" returned: 0 in 0.815s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-865b0f4b-e24d-47d7-b528-525ead878f6e" returned: 0 in 0.932s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-865b0f4b-e24d-47d7-b528-525ead878f6e {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-865b0f4b-e24d-47d7-b528-525ead878f6e" returned: 0 in 0.356s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:16 devstack quobyte-client[84221]: System call of process 102318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-quobyte-865b0f4b-e24d-47d7-b528-525ead878f6e" released by "delete_volume" :: held 1.563s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca" returned: 1 in 0.620s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca' failed. Not Retrying. {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created reservations ['b1b3c179-23f4-4299-acc8-ee93aaf78792', 'd14f1849-f308-443f-9916-4cfd437c3eff', '0312224b-982a-447f-a5f5-bcf6d89973fd', '8f67d31a-484c-4a43-aeed-e786f401fd7b'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6986918-d3cc-4a50-a751-12962f7fffca" returned: 0 in 0.311s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Lock "cinder-quobyte-f6986918-d3cc-4a50-a751-12962f7fffca" released by "delete_volume" :: held 2.007s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Created reservations ['859b159d-e92e-4276-a158-6ff3b7b54537', '5112b98f-354d-4c2c-88bf-487c46247e92', '698bd09b-2e6f-4207-a5c2-cc96d87ec2ed', 'af1d4902-6f9d-4690-9236-50b726f82b17'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Created reservations ['de02810c-af7c-41ee-b790-cce3828104d4', '64761e7a-959d-42f7-916b-e66373f2c50a', '786ecfff-9c9a-4448-88c2-cc348226d268', '0bb3aae7-c27d-4c7c-bce3-9cd86ca5a6a2'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.757s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:17 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Deleted volume successfully.
Sep 27 12:09:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-5d3ea0df-81a2-4f49-b28b-3107e7f62940-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.753s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.555s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:18 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Deleted volume successfully.
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:18 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Deleted volume successfully.
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-5d3ea0df-81a2-4f49-b28b-3107e7f62940-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e675d1a9-42af-481a-a4d9-59d262e9c483 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-6d8ecdcc-3c1c-4f43-adb3-cc8e4ffb55a8-delete_volume" released by "delete_volume" :: held 4.501s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c15ab4af-455d-4080-96af-2aa890efb60a tempest-CreateVolumesFromImageTest-650751598 None] Lock "cinder-865b0f4b-e24d-47d7-b528-525ead878f6e-delete_volume" released by "delete_volume" :: held 4.509s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-8a61f4ce-862b-4b06-b6f1-4f0d5a70f241 tempest-VolumeImageDependencyTests-402681674 None] Lock "cinder-f6986918-d3cc-4a50-a751-12962f7fffca-delete_volume" released by "delete_volume" :: held 3.913s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:18 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-quobyte-5d3ea0df-81a2-4f49-b28b-3107e7f62940" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-5d3ea0df-81a2-4f49-b28b-3107e7f62940" acquired by "delete_volume" :: waited 0.010s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9b5c93-4d35-424d-a689-917415e5d275]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:18 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:18 devstack quobyte-client[84221]: System call of process 102327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940" returned: 0 in 0.623s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:19 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5d3ea0df-81a2-4f49-b28b-3107e7f62940" returned: 0 in 0.292s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:19 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-5d3ea0df-81a2-4f49-b28b-3107e7f62940" released by "delete_volume" :: held 1.221s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created reservations ['4839037c-e26e-4d4d-8950-cb9186d6f35f', '9e90524a-8c09-4563-be9b-d94ec82b08aa', '8f5cb898-70e3-473f-a587-03dd15916eec', '22ad4d14-ecd6-42dc-ad2f-83af8bcc3703'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-5326f869-7862-4893-b9a7-e3490b68ebf7-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.385s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:20 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Deleted volume successfully.
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-5326f869-7862-4893-b9a7-e3490b68ebf7-delete_volume" acquired by "delete_volume" :: waited 0.276s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:20 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-af93c79c-b357-4ea3-bde5-9f62c7c7dac0 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-5d3ea0df-81a2-4f49-b28b-3107e7f62940-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:21 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-quobyte-5326f869-7862-4893-b9a7-e3490b68ebf7" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:21 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-5326f869-7862-4893-b9a7-e3490b68ebf7" acquired by "delete_volume" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:21 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[0119b681-bc22-46d2-a80f-cf29624899be]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5326f869-7862-4893-b9a7-e3490b68ebf7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5326f869-7862-4893-b9a7-e3490b68ebf7" returned: 0 in 0.606s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5326f869-7862-4893-b9a7-e3490b68ebf7 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:21 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-5326f869-7862-4893-b9a7-e3490b68ebf7" returned: 0 in 0.151s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-5326f869-7862-4893-b9a7-e3490b68ebf7" released by "delete_volume" :: held 1.016s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created reservations ['ef1f646b-e26d-4665-95f2-33f76053ed71', '38d68aad-08ca-4dea-bd3f-79b28a153bae', '1d69f179-7077-4789-9b3c-906bae7d5121', '9b5d3019-2b8b-4790-adac-2cae3efe674f'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.172s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:22 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:23 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Deleted volume successfully.
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-65daa7f4-f9cf-4bed-847f-1fd612d22004 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-5326f869-7862-4893-b9a7-e3490b68ebf7-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.183s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-quobyte-19a98810-f699-4322-9ad8-6e18357f6bc2" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:23 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Flow 'volume_create_manager' (ff9a0a6d-ffe8-4cc1-8daf-609be5afe050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70231a9-2f3d-4948-bfc0-1a0693770fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70231a9-2f3d-4948-bfc0-1a0693770fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156ead36-9b72-40e1-b6f4-325d616f3309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4fc6012082404f92c0b6a41db41be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:23Z,use_quota=True,user_id='2e7d3378d59c4233bd4bf87a8ab61950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccbace7-1ea8-42f5-9e0c-710c62416be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccbace7-1ea8-42f5-9e0c-710c62416be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249a5e33-34b3-4169-9c39-2765206694b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249a5e33-34b3-4169-9c39-2765206694b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '156ead36-9b72-40e1-b6f4-325d616f3309', 'volume_name': 'volume-156ead36-9b72-40e1-b6f4-325d616f3309', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3698ea-bb9f-4117-972e-f22ccb16669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3698ea-bb9f-4117-972e-f22ccb16669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dd1fc0-62b9-4121-a4b0-5ec14a4f6ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:23 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Volume 156ead36-9b72-40e1-b6f4-325d616f3309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-156ead36-9b72-40e1-b6f4-325d616f3309', 'volume_size': 1}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156ead36-9b72-40e1-b6f4-325d616f3309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4fc6012082404f92c0b6a41db41be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:23Z,use_quota=True,user_id='2e7d3378d59c4233bd4bf87a8ab61950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Creating volume 156ead36-9b72-40e1-b6f4-325d616f3309 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:23 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-156ead36-9b72-40e1-b6f4-325d616f3309 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:23 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-19a98810-f699-4322-9ad8-6e18357f6bc2" acquired by "delete_snapshot" :: waited 0.436s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-quobyte-a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:24 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=160, name=volume-156ead36-9b72-40e1-b6f4-325d616f3309, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d" acquired by "_delete_snapshot" :: waited 0.388s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Deleting offline snapshot a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d of volume 19a98810-f699-4322-9ad8-6e18357f6bc2 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] snapshot_file for this snap is: volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e067e134-8dde-4f04-9791-7634ec67bd4c]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-156ead36-9b72-40e1-b6f4-325d616f3309 1073741824" returned: 0 in 0.996s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-156ead36-9b72-40e1-b6f4-325d616f3309 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-156ead36-9b72-40e1-b6f4-325d616f3309" returned: 0 in 0.190s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:24 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] <== create_volume: return (1306ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dd1fc0-62b9-4121-a4b0-5ec14a4f6ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-156ead36-9b72-40e1-b6f4-325d616f3309', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:25 devstack quobyte-client[84221]: System call of process 102372 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3086d01a-1204-44b2-9f43-70cb4bf02772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d" returned: 0 in 0.732s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:25 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19a98810-f699-4322-9ad8-6e18357f6bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 12:09:25 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Volume volume-156ead36-9b72-40e1-b6f4-325d616f3309 (156ead36-9b72-40e1-b6f4-325d616f3309): created successfully
Sep 27 12:09:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3086d01a-1204-44b2-9f43-70cb4bf02772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:25 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Flow 'volume_create_manager' (ff9a0a6d-ffe8-4cc1-8daf-609be5afe050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:25 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58378ca-eecc-4fb5-a7d4-5d214da9cbe7]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:25 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:25 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-7817dd8a-e951-43b5-b81c-8b626c2a9074 tempest-CinderUnicodeTest-2044822999 None] Created volume successfully.
Sep 27 12:09:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2" returned: 0 in 0.599s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:26 devstack quobyte-client[84221]: System call of process 102381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d" returned: 0 in 0.274s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:26 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2.a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d" returned: 0 in 0.150s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d" released by "_delete_snapshot" :: held 2.312s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:26 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-19a98810-f699-4322-9ad8-6e18357f6bc2" released by "delete_snapshot" :: held 2.839s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created reservations ['ecfd9916-1c82-4603-814c-80ebc160169d', '3d8a7c83-e3bb-4bb7-888c-d82a64b93732', '058be988-fbcb-4de8-83e3-05d6882366d6', '8717ed27-6101-4816-b859-83a3e9a8418f'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:27 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Flow 'volume_create_manager' (dc2af70c-a23d-4b79-a03c-5d8f2bc5436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da534c9-3267-4684-97d6-ef9fc0fba261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da534c9-3267-4684-97d6-ef9fc0fba261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-390165711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96cae16-efab-4404-afd4-7e9237d98c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4fc6012082404f92c0b6a41db41be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:27Z,use_quota=True,user_id='2e7d3378d59c4233bd4bf87a8ab61950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a89063-9fed-4e1a-bef8-8b90b4bd58f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a89063-9fed-4e1a-bef8-8b90b4bd58f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbf79f5-f2c9-495b-874e-3d8af97015b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbf79f5-f2c9-495b-874e-3d8af97015b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96cae16-efab-4404-afd4-7e9237d98c53', 'volume_name': 'volume-e96cae16-efab-4404-afd4-7e9237d98c53', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c788c6-8f04-4b16-9520-5b24a8337d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c788c6-8f04-4b16-9520-5b24a8337d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b40c39f-8513-4fe9-82fe-9775021e1fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:27 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Volume e96cae16-efab-4404-afd4-7e9237d98c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96cae16-efab-4404-afd4-7e9237d98c53', 'volume_size': 1}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-390165711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96cae16-efab-4404-afd4-7e9237d98c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4fc6012082404f92c0b6a41db41be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:27Z,use_quota=True,user_id='2e7d3378d59c4233bd4bf87a8ab61950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Creating volume e96cae16-efab-4404-afd4-7e9237d98c53 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:27 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:27 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:27 devstack quobyte-client[84221]: System call of process 102385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:27 devstack quobyte-client[84221]: System call of process 102385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:27 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=161, name=volume-e96cae16-efab-4404-afd4-7e9237d98c53, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:27 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Delete snapshot completed successfully.
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-064e957f-483c-427d-ab8f-4e3cd2db5c19 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-a8e0d3f0-87fb-41b5-a8cd-c2e30365fb6d-delete_snapshot" released by "delete_snapshot" :: held 4.612s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 1073741824" returned: 0 in 0.567s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53" returned: 0 in 0.145s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] <== create_volume: return (770ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-19a98810-f699-4322-9ad8-6e18357f6bc2-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b40c39f-8513-4fe9-82fe-9775021e1fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96cae16-efab-4404-afd4-7e9237d98c53', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9bee2b-6fd5-483d-907a-ba02e048d904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-19a98810-f699-4322-9ad8-6e18357f6bc2-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:28 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Volume volume-e96cae16-efab-4404-afd4-7e9237d98c53 (e96cae16-efab-4404-afd4-7e9237d98c53): created successfully
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9bee2b-6fd5-483d-907a-ba02e048d904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Flow 'volume_create_manager' (dc2af70c-a23d-4b79-a03c-5d8f2bc5436a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:28 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-2b1310fc-40af-48d6-bb97-2503eeaf65d7 tempest-CinderUnicodeTest-2044822999 None] Created volume successfully.
Sep 27 12:09:28 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "cinder-quobyte-19a98810-f699-4322-9ad8-6e18357f6bc2" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-19a98810-f699-4322-9ad8-6e18357f6bc2" acquired by "delete_volume" :: waited 0.013s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa827a13-be1a-4c49-8c15-69563c7106c8]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:28 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:29 devstack quobyte-client[84221]: System call of process 102390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2" returned: 0 in 0.462s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:29 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-19a98810-f699-4322-9ad8-6e18357f6bc2" returned: 0 in 0.119s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:29 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-quobyte-19a98810-f699-4322-9ad8-6e18357f6bc2" released by "delete_volume" :: held 1.004s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:30 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:30 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Creating offline snapshot 3beadd41-0771-4cc7-878f-be632f735233 of volume e96cae16-efab-4404-afd4-7e9237d98c53 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 12:09:30 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e88a2-c011-4550-9130-ee5b6929f6cc]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:30 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Created reservations ['96994673-9975-45ec-9160-2f61030804d1', 'a9fa3fa3-ce4d-451c-b833-752c1cb22d60', '11888885-a91a-448c-9137-8ebf859be9e8', '34974f07-ac35-4b75-bbad-ea2f85cf0ff2'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:30 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:31 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:31 devstack quobyte-client[84221]: System call of process 102394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.254s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:31 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:31 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Deleted volume successfully.
Sep 27 12:09:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53" returned: 0 in 1.363s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:31 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:31 devstack quobyte-client[84221]: System call of process 102398 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:31 devstack quobyte-client[84221]: System call of process 102398 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:32 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=162, name=volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:32 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fc876efb-2984-4790-b164-ca76aa7e4746 tempest-CreateVolumesFromSnapshotTest-326605136 None] Lock "cinder-19a98810-f699-4322-9ad8-6e18357f6bc2-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 1G" returned: 0 in 0.442s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e96cae16-efab-4404-afd4-7e9237d98c53 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:32 devstack quobyte-client[84221]: System call of process 102401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:32 devstack quobyte-client[84221]: System call of process 102401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] CMD "qemu-img rebase -u -b volume-e96cae16-efab-4404-afd4-7e9237d98c53 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233" returned: 0 in 0.257s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 12:09:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233" returned: 0 in 0.196s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:32 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 12:09:32 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233" returned: 0 in 0.322s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.info" returned: 0 in 0.166s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:33 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 12:09:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.info" returned: 0 in 0.152s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:33 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.282s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:33 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-05ea29ba-f8bf-4027-b3b6-32d7a5c8818a tempest-CinderUnicodeTest-2044822999 None] Create snapshot completed successfully
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "cinder-3beadd41-0771-4cc7-878f-be632f735233-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-3beadd41-0771-4cc7-878f-be632f735233-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:34 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "cinder-quobyte-e96cae16-efab-4404-afd4-7e9237d98c53" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-quobyte-e96cae16-efab-4404-afd4-7e9237d98c53" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "cinder-quobyte-3beadd41-0771-4cc7-878f-be632f735233" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-quobyte-3beadd41-0771-4cc7-878f-be632f735233" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Deleting offline snapshot 3beadd41-0771-4cc7-878f-be632f735233 of volume e96cae16-efab-4404-afd4-7e9237d98c53 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] snapshot_file for this snap is: volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[09201d91-da42-437e-acd9-1eb15dcafbec]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:34 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=85,cinder:UPDATE=150,cinder:DELETE=16,cinder:INSERT=18 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:09:35 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=117,cinder:SELECT=90,cinder:DELETE=12,cinder:INSERT=43 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:09:35 devstack quobyte-client[84221]: System call of process 102408 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233" returned: 0 in 0.659s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:35 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e96cae16-efab-4404-afd4-7e9237d98c53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 12:09:35 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fc2cc0-b8f2-4955-89db-87e2199661a1]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:35 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53" returned: 0 in 0.569s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233" returned: 0 in 0.341s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:36 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53.3beadd41-0771-4cc7-878f-be632f735233" returned: 0 in 0.405s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:36 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-quobyte-3beadd41-0771-4cc7-878f-be632f735233" released by "_delete_snapshot" :: held 2.409s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:36 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:36 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (a78b4adc-7088-4a1f-80c9-473ef4416146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2045f407-d1ff-4ff0-8c4c-a350bc394a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-quobyte-e96cae16-efab-4404-afd4-7e9237d98c53" released by "delete_snapshot" :: held 2.601s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2045f407-d1ff-4ff0-8c4c-a350bc394a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1225957184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b75d6f-c932-42b0-80aa-29d18c3a9229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:36Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db418dd-03ef-4292-9cf4-f7c054adc321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db418dd-03ef-4292-9cf4-f7c054adc321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efad494-26c5-4959-bc53-caf69ad80c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efad494-26c5-4959-bc53-caf69ad80c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b75d6f-c932-42b0-80aa-29d18c3a9229', 'volume_name': 'volume-98b75d6f-c932-42b0-80aa-29d18c3a9229', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb468e8-43ff-4e3c-baf8-3c1526b3cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb468e8-43ff-4e3c-baf8-3c1526b3cd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4809a3f3-4f60-4727-aaff-36aa41f724b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:37 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume 98b75d6f-c932-42b0-80aa-29d18c3a9229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b75d6f-c932-42b0-80aa-29d18c3a9229', 'volume_size': 1}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1225957184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b75d6f-c932-42b0-80aa-29d18c3a9229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:36Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Creating volume 98b75d6f-c932-42b0-80aa-29d18c3a9229 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:37 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-98b75d6f-c932-42b0-80aa-29d18c3a9229 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:37 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=164, name=volume-98b75d6f-c932-42b0-80aa-29d18c3a9229, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-98b75d6f-c932-42b0-80aa-29d18c3a9229 1073741824" returned: 0 in 0.520s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:37 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-98b75d6f-c932-42b0-80aa-29d18c3a9229 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-98b75d6f-c932-42b0-80aa-29d18c3a9229" returned: 0 in 0.240s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] <== create_volume: return (819ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4809a3f3-4f60-4727-aaff-36aa41f724b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b75d6f-c932-42b0-80aa-29d18c3a9229', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4889e1-5761-4ccb-ab86-9ff8e9fc0b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Created reservations ['1c9f9ed1-0a60-4b94-9efa-410c00c9b17b', '15577ce6-696d-435b-9ea3-01eab05f1b66', '507d6739-de5d-4379-9e9a-35f54677eb76', '217d2550-210c-471e-920e-879e06ff4bc8'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:38 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume volume-98b75d6f-c932-42b0-80aa-29d18c3a9229 (98b75d6f-c932-42b0-80aa-29d18c3a9229): created successfully
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4889e1-5761-4ccb-ab86-9ff8e9fc0b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (a78b4adc-7088-4a1f-80c9-473ef4416146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-88120cd9-97d4-45f2-a834-67e8b159d930 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created volume successfully.
Sep 27 12:09:38 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Delete snapshot completed successfully.
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-54b8cc62-16db-40b0-a32b-20b33b64739c tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-3beadd41-0771-4cc7-878f-be632f735233-delete_snapshot" released by "delete_snapshot" :: held 4.095s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "cinder-e96cae16-efab-4404-afd4-7e9237d98c53-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:38 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-e96cae16-efab-4404-afd4-7e9237d98c53-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:39 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "cinder-quobyte-e96cae16-efab-4404-afd4-7e9237d98c53" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-quobyte-e96cae16-efab-4404-afd4-7e9237d98c53" acquired by "delete_volume" :: waited 0.010s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7956a13-5c27-4400-b60f-bef618130672]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.623s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:40 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:09:40 devstack quobyte-client[84221]: System call of process 102424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:40 devstack quobyte-client[84221]: System call of process 102424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (4be87514-6a7c-4f0d-9162-c465c83dcb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735d5bcc-320b-4f44-b26c-9f2de6cd101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735d5bcc-320b-4f44-b26c-9f2de6cd101c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672019528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a78e5a-da40-41fe-be7a-f1a8134fa34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:40Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b5f8af-a3ce-4c88-8b50-bfa97ae459d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b5f8af-a3ce-4c88-8b50-bfa97ae459d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74130bfb-b45b-499a-a630-b79ac40a90b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74130bfb-b45b-499a-a630-b79ac40a90b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49a78e5a-da40-41fe-be7a-f1a8134fa34c', 'volume_name': 'volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68182d00-c012-4f3e-a9ce-4cfc6af01c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68182d00-c012-4f3e-a9ce-4cfc6af01c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0d4cb2-4a8b-4ff5-b027-061f32e1fe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:40 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume 49a78e5a-da40-41fe-be7a-f1a8134fa34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c', 'volume_size': 1}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672019528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a78e5a-da40-41fe-be7a-f1a8134fa34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:40Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Creating volume 49a78e5a-da40-41fe-be7a-f1a8134fa34c {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:40 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:40 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:40 devstack quobyte-client[84221]: System call of process 102428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:40 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=165, name=volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53" returned: 0 in 1.948s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:41 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:09:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (8eaf1e93-b101-4cf6-9041-fc259542d700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:41 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63340e3-d159-432b-8477-49073d3843af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:41 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:41 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:41 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (97310486-c778-43a8-b2ca-188a7e288e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16a76df-3bd9-4e95-a77e-fe9bebd1de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c 1073741824" returned: 0 in 1.533s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63340e3-d159-432b-8477-49073d3843af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1542942600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6553c8f-c538-415a-bbb7-1af7dfe1f767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:40Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74ae629-26b0-4d51-ae6d-8e5e1083b32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74ae629-26b0-4d51-ae6d-8e5e1083b32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2bfaf7-e926-4fdd-b357-49ed0cb32a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2bfaf7-e926-4fdd-b357-49ed0cb32a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6553c8f-c538-415a-bbb7-1af7dfe1f767', 'volume_name': 'volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f456a0ad-eadd-434b-95d7-7f8f4d64a705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f456a0ad-eadd-434b-95d7-7f8f4d64a705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a49389-ba27-49fa-9e52-688c2eeaa1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume f6553c8f-c538-415a-bbb7-1af7dfe1f767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767', 'volume_size': 1}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-e96cae16-efab-4404-afd4-7e9237d98c53" returned: 0 in 1.122s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16a76df-3bd9-4e95-a77e-fe9bebd1de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1281075034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697d39aa-9085-46b4-b0a5-2c0f75bc0407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:41Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bb0c0f-8fcc-4531-98d9-bf33208f6311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bb0c0f-8fcc-4531-98d9-bf33208f6311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb91332-e103-4dfb-9fdf-a5762ec9d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb91332-e103-4dfb-9fdf-a5762ec9d51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697d39aa-9085-46b4-b0a5-2c0f75bc0407', 'volume_name': 'volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1a11ee-70f8-4c4a-90e7-c7e5f221577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1a11ee-70f8-4c4a-90e7-c7e5f221577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499d1c84-5c47-42da-b7a2-41a9d3c11674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume 697d39aa-9085-46b4-b0a5-2c0f75bc0407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407', 'volume_size': 1}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:42 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (55a055b9-2e74-4f82-8fd0-a1e40a58a9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae6fbdb-60a3-4e12-ae2f-c412b634c4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-quobyte-e96cae16-efab-4404-afd4-7e9237d98c53" released by "delete_volume" :: held 3.718s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c" returned: 0 in 0.739s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] <== create_volume: return (2365ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.374s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1542942600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6553c8f-c538-415a-bbb7-1af7dfe1f767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:40Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Creating volume f6553c8f-c538-415a-bbb7-1af7dfe1f767 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:42 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:42 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:43 devstack quobyte-client[84221]: System call of process 102433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:43 devstack quobyte-client[84221]: System call of process 102433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:43 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=166, name=volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae6fbdb-60a3-4e12-ae2f-c412b634c4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177427513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c8179b-38f0-48fc-bd6f-55917cc8b420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:41Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ec3071-77c7-428a-b2b5-03a854d9cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ec3071-77c7-428a-b2b5-03a854d9cf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62658e50-af0a-4d09-9eb2-4af2852138bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62658e50-af0a-4d09-9eb2-4af2852138bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c8179b-38f0-48fc-bd6f-55917cc8b420', 'volume_name': 'volume-78c8179b-38f0-48fc-bd6f-55917cc8b420', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d546b133-c4d7-427a-b90e-2be9b7763597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d546b133-c4d7-427a-b90e-2be9b7763597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa49647c-72c1-46e6-9b1a-e98a355c2384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume 78c8179b-38f0-48fc-bd6f-55917cc8b420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c8179b-38f0-48fc-bd6f-55917cc8b420', 'volume_size': 1}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:43 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (2f0855d7-e1f0-4bec-abea-fcec8902ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b264b0a-10c6-488d-8845-a81e1e86b29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0d4cb2-4a8b-4ff5-b027-061f32e1fe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a4f1e3-5157-4113-9af3-3ff54e03c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b264b0a-10c6-488d-8845-a81e1e86b29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-483655567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee8bf8a-04e9-484f-b6e2-9cdf6e489b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:42Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943be5bd-2af1-4495-8f60-193811c10745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943be5bd-2af1-4495-8f60-193811c10745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20b8999-1dff-4871-8808-6d0baec67c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20b8999-1dff-4871-8808-6d0baec67c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee8bf8a-04e9-484f-b6e2-9cdf6e489b98', 'volume_name': 'volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824c7020-10ee-40dc-b08c-9725acc86899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824c7020-10ee-40dc-b08c-9725acc86899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e285a6-72be-4df3-8228-236a3e452ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:43 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume eee8bf8a-04e9-484f-b6e2-9cdf6e489b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98', 'volume_size': 1}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:43 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c (49a78e5a-da40-41fe-be7a-f1a8134fa34c): created successfully
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a4f1e3-5157-4113-9af3-3ff54e03c262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (4be87514-6a7c-4f0d-9162-c465c83dcb22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:43 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-8f70bcf4-b730-4f6b-bcb1-c00c66d47513 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created volume successfully.
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767 1073741824" returned: 0 in 0.856s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:43 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767" returned: 0 in 0.273s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] <== create_volume: return (1171ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1281075034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697d39aa-9085-46b4-b0a5-2c0f75bc0407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:41Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Creating volume 697d39aa-9085-46b4-b0a5-2c0f75bc0407 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:44 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:44 devstack quobyte-client[84221]: System call of process 102437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:44 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=167, name=volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a49389-ba27-49fa-9e52-688c2eeaa1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d7b6c3-c37a-4a34-af0c-0d814d24d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Created reservations ['deeb9755-c289-439f-95f8-6f940cfa7d04', 'f6a04381-efe3-4f94-8391-8f2b98343e91', '8e286fc2-4cf7-4497-af00-b40743f1f5ec', 'e191fb4b-8c90-4d4b-abf1-214f520943f9'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407 1073741824" returned: 0 in 0.631s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:44 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:45 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767 (f6553c8f-c538-415a-bbb7-1af7dfe1f767): created successfully
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d7b6c3-c37a-4a34-af0c-0d814d24d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (8eaf1e93-b101-4cf6-9041-fc259542d700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407" returned: 0 in 0.618s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] <== create_volume: return (1317ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:45 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-38fe6047-a3a5-4e7f-91b6-b84ac568fbfc tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created volume successfully.
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.347s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177427513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c8179b-38f0-48fc-bd6f-55917cc8b420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:41Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Creating volume 78c8179b-38f0-48fc-bd6f-55917cc8b420 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:45 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:45 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-78c8179b-38f0-48fc-bd6f-55917cc8b420 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:45 devstack quobyte-client[84221]: System call of process 102441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:45 devstack quobyte-client[84221]: System call of process 102441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:45 devstack quobyte-client[84221]: System call of process 102441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:45 devstack quobyte-client[84221]: System call of process 102441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:45 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=168, name=volume-78c8179b-38f0-48fc-bd6f-55917cc8b420, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "cinder-156ead36-9b72-40e1-b6f4-325d616f3309-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499d1c84-5c47-42da-b7a2-41a9d3c11674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc30e66-9220-4684-ad8a-71a2943390f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-78c8179b-38f0-48fc-bd6f-55917cc8b420 1073741824" returned: 0 in 0.734s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-78c8179b-38f0-48fc-bd6f-55917cc8b420 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:46 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407 (697d39aa-9085-46b4-b0a5-2c0f75bc0407): created successfully
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc30e66-9220-4684-ad8a-71a2943390f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (97310486-c778-43a8-b2ca-188a7e288e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:46 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-156ead36-9b72-40e1-b6f4-325d616f3309-delete_volume" acquired by "delete_volume" :: waited 1.038s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:47 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-d14cbd14-dbf6-4389-8aee-9e7a4d106887 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created volume successfully.
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-78c8179b-38f0-48fc-bd6f-55917cc8b420" returned: 0 in 1.178s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] <== create_volume: return (1947ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.891s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-483655567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee8bf8a-04e9-484f-b6e2-9cdf6e489b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680f40562d5749539fed0d43ad7de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:42Z,use_quota=True,user_id='173435f4ed3c401faf7b1effeb1d6c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Creating volume eee8bf8a-04e9-484f-b6e2-9cdf6e489b98 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:47 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:47 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:47 devstack quobyte-client[84221]: System call of process 102446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:47 devstack quobyte-client[84221]: System call of process 102446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:47 devstack quobyte-client[84221]: System call of process 102446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:47 devstack quobyte-client[84221]: System call of process 102446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:47 devstack quobyte-client[84221]: System call of process 102446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:47 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=169, name=volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa49647c-72c1-46e6-9b1a-e98a355c2384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c8179b-38f0-48fc-bd6f-55917cc8b420', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9789d9-70bf-4bb7-a30b-7c38b7092420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 1.278s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:48 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:48 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Deleted volume successfully.
Sep 27 12:09:48 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume volume-78c8179b-38f0-48fc-bd6f-55917cc8b420 (78c8179b-38f0-48fc-bd6f-55917cc8b420): created successfully
Sep 27 12:09:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9789d9-70bf-4bb7-a30b-7c38b7092420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:48 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (55a055b9-2e74-4f82-8fd0-a1e40a58a9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98 1073741824" returned: 0 in 0.854s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:48 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:48 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-adc9695f-fce8-400e-8542-8a78d26fced9 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created volume successfully.
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e03d59b9-fcd0-4b1d-b240-8b8341197d60 tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-e96cae16-efab-4404-afd4-7e9237d98c53-delete_volume" released by "delete_volume" :: held 10.057s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:49 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "cinder-quobyte-156ead36-9b72-40e1-b6f4-325d616f3309" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98" returned: 0 in 0.676s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] <== create_volume: return (1558ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-quobyte-156ead36-9b72-40e1-b6f4-325d616f3309" acquired by "delete_volume" :: waited 0.095s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e285a6-72be-4df3-8228-236a3e452ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b841dc-36b8-4544-b3c3-6de5388a95c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b50d074-c0d3-4478-9384-5a93650322d9]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-156ead36-9b72-40e1-b6f4-325d616f3309 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:49 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98 (eee8bf8a-04e9-484f-b6e2-9cdf6e489b98): created successfully
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b841dc-36b8-4544-b3c3-6de5388a95c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:49 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Flow 'volume_create_manager' (2f0855d7-e1f0-4bec-abea-fcec8902ce23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:49 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-47fd0eee-25a5-4fae-bdc7-7925c3736ec1 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created volume successfully.
Sep 27 12:09:50 devstack quobyte-client[84221]: System call of process 102451 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:50 devstack quobyte-client[84221]: System call of process 102451 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:50 devstack quobyte-client[84221]: System call of process 102451 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-156ead36-9b72-40e1-b6f4-325d616f3309" returned: 0 in 0.836s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-156ead36-9b72-40e1-b6f4-325d616f3309 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-156ead36-9b72-40e1-b6f4-325d616f3309" returned: 0 in 0.131s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-quobyte-156ead36-9b72-40e1-b6f4-325d616f3309" released by "delete_volume" :: held 1.369s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98-delete_volume" acquired by "delete_volume" :: waited 0.257s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:50 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-quobyte-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98" acquired by "delete_volume" :: waited 0.015s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cadc2c0-6c97-450b-bfed-d11f2661c4b6]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:50 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Created reservations ['c211993e-7edc-4ff0-9a4b-20f6f089e332', '012623cc-0a24-47c6-96c6-c2f4d078c775', 'edb76459-d23e-46dc-85b8-a089076b6d6d', '47cb511a-4370-46d2-ac9a-7cbc35617d59'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:51 devstack quobyte-client[84221]: System call of process 102455 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:51 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Flow 'volume_create_manager' (fef91386-dc53-419b-a04b-a3e083b85821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987f1e77-282b-4cea-a43a-7fabb120538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987f1e77-282b-4cea-a43a-7fabb120538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-739917790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9c9eff-0057-4408-9682-8680f4c00ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7069c50515954a1892f9fd85d1199772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:51Z,use_quota=True,user_id='f22e410014d548b3b151793901d2b649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4354397f-e150-4733-8715-0f9f7c40997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4354397f-e150-4733-8715-0f9f7c40997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf6feaf-e34f-409c-8f56-a9bbc1cde8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf6feaf-e34f-409c-8f56-a9bbc1cde8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9c9eff-0057-4408-9682-8680f4c00ae6', 'volume_name': 'volume-ce9c9eff-0057-4408-9682-8680f4c00ae6', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cf7801-d902-47bc-99be-1c3896b4934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cf7801-d902-47bc-99be-1c3896b4934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b36470-8ed4-4656-9f5d-664855152e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:51 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Volume ce9c9eff-0057-4408-9682-8680f4c00ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9c9eff-0057-4408-9682-8680f4c00ae6', 'volume_size': 1}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fce5dd7d660>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-739917790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9c9eff-0057-4408-9682-8680f4c00ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7069c50515954a1892f9fd85d1199772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:09:51Z,use_quota=True,user_id='f22e410014d548b3b151793901d2b649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)}" {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Creating volume ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:09:51 devstack cinder-volume[84197]: INFO cinder.volume.drivers.remotefs [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] casted to 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8
Sep 27 12:09:51 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 1073741824 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:51 devstack quobyte-client[84221]: System call of process 102458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:51 devstack quobyte-client[84221]: System call of process 102458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:51 devstack quobyte-client[84221]: System call of process 102458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:51 devstack quobyte-client[84221]: System call of process 102458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:52 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=170, name=volume-ce9c9eff-0057-4408-9682-8680f4c00ae6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98" returned: 0 in 1.095s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 1073741824" returned: 0 in 0.591s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98" returned: 0 in 0.403s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6" returned: 0 in 0.399s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] <== create_volume: return (1055ms) {'provider_location': '10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'} {{(pid=84197) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:52 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98" released by "delete_volume" :: held 2.026s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.424s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b36470-8ed4-4656-9f5d-664855152e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9c9eff-0057-4408-9682-8680f4c00ae6', 'volume_size': 1}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b565c108-795e-4c91-bd73-d5dc3bf4c8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:09:53 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Deleted volume successfully.
Sep 27 12:09:53 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Volume volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 (ce9c9eff-0057-4408-9682-8680f4c00ae6): created successfully
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b565c108-795e-4c91-bd73-d5dc3bf4c8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Flow 'volume_create_manager' (fef91386-dc53-419b-a04b-a3e083b85821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-e25f360d-a198-4699-bea5-b5df1fc7dc1d tempest-CinderUnicodeTest-2044822999 None] Lock "cinder-156ead36-9b72-40e1-b6f4-325d616f3309-delete_volume" released by "delete_volume" :: held 6.115s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:53 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-84bcd57e-db0e-4f41-ade3-e6b7f2b06d95 tempest-SnapshotDependencyTests-205885686 None] Created volume successfully.
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created reservations ['eb4a0c03-8349-4ae7-b20b-cddff8ccfd3b', 'd066db20-ca43-4fba-bc0a-1dafcf30207c', 'ccf7b02b-f2cb-4146-855e-15972f2f575a', '01ad1428-b9f4-4cd5-bd95-a786b6dd5566'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.101s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:53 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Deleted volume successfully.
Sep 27 12:09:53 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-d320bcc0-36b2-48d2-a7ff-0c27243de71d tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-eee8bf8a-04e9-484f-b6e2-9cdf6e489b98-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:54 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-78c8179b-38f0-48fc-bd6f-55917cc8b420-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:54 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-78c8179b-38f0-48fc-bd6f-55917cc8b420-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:54 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:54 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-quobyte-78c8179b-38f0-48fc-bd6f-55917cc8b420" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:54 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-78c8179b-38f0-48fc-bd6f-55917cc8b420" acquired by "delete_volume" :: waited 0.010s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:54 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58e172c-f63f-47e4-8fb6-52793462b198]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-78c8179b-38f0-48fc-bd6f-55917cc8b420 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:54 devstack quobyte-client[84221]: System call of process 102465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:54 devstack quobyte-client[84221]: System call of process 102465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:54 devstack quobyte-client[84221]: System call of process 102465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-78c8179b-38f0-48fc-bd6f-55917cc8b420" returned: 0 in 0.648s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:54 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-78c8179b-38f0-48fc-bd6f-55917cc8b420 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:55 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-78c8179b-38f0-48fc-bd6f-55917cc8b420" returned: 0 in 0.353s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:55 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Creating offline snapshot 4ca15c7f-7176-4181-a4dc-4e9f3a023d3b of volume ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 27 12:09:55 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[62980df6-ca8f-48b3-9c11-1109ab78cb9b]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:55 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:55 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-78c8179b-38f0-48fc-bd6f-55917cc8b420" released by "delete_volume" :: held 1.283s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:55 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created reservations ['4c6be58c-7b05-468e-b7dc-e5a9a138c8c2', 'fc0cfb29-83bb-4dc2-a640-7c28bc03a52e', 'bba95aa2-de09-45b9-981d-c4cde5103a46', '07df8039-73de-46fa-878d-2fbceb661d47'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:55 devstack quobyte-client[84221]: System call of process 102469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6" returned: 0 in 0.643s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b 1G {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:56 devstack quobyte-client[84221]: System call of process 102472 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:56 devstack quobyte-client[84221]: System call of process 102472 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:56 devstack quobyte-client[84221]: System call of process 102472 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:56 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=171, name=volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b 1G" returned: 0 in 0.406s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:56 devstack quobyte-client[84221]: System call of process 102476 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:56 devstack quobyte-client[84221]: System call of process 102476 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-697d39aa-9085-46b4-b0a5-2c0f75bc0407-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.460s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] CMD "qemu-img rebase -u -b volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 -F qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" returned: 0 in 0.334s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:09:56 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Deleted volume successfully.
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 12:09:56 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-697d39aa-9085-46b4-b0a5-2c0f75bc0407-delete_volume" acquired by "delete_volume" :: waited 0.467s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" returned: 0 in 0.325s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:57 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Setting permissions: /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 -> 1000:1000 {{(pid=84197) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 27 12:09:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:57 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-fe283de7-7af7-4c9d-899f-2de3c228b48e tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-78c8179b-38f0-48fc-bd6f-55917cc8b420-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" returned: 0 in 0.317s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:57 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.info" returned: 0 in 0.334s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:58 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:09:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-quobyte-697d39aa-9085-46b4-b0a5-2c0f75bc0407" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:09:58 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.info is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 12:09:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.info {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.info" returned: 0 in 0.179s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.085s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:58 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-697d39aa-9085-46b4-b0a5-2c0f75bc0407" acquired by "delete_volume" :: waited 0.410s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:09:58 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd759d-1c1f-4508-9eca-575892693b1f]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:09:58 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:58 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c65bd3c6-462e-4887-9249-a98af971db48 tempest-SnapshotDependencyTests-205885686 None] Create snapshot completed successfully
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407" returned: 0 in 0.509s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-697d39aa-9085-46b4-b0a5-2c0f75bc0407" returned: 0 in 0.140s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-697d39aa-9085-46b4-b0a5-2c0f75bc0407" released by "delete_volume" :: held 0.834s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created reservations ['8e84acd6-8505-43bc-8537-aba1c914ecd5', 'a1e437b2-1ae9-4abb-89bb-dcc9f498a1b6', 'b5095004-2b3b-4a07-8150-5b8498c43f9b', '0c5af75a-d372-47d7-a0f7-73cc563d6142'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:09:59 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-f6553c8f-c538-415a-bbb7-1af7dfe1f767-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.405s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:10:00 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Deleted volume successfully.
Sep 27 12:10:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84197) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-f6553c8f-c538-415a-bbb7-1af7dfe1f767-delete_volume" acquired by "delete_volume" :: waited 0.182s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-26b763a4-dc91-4226-875e-5b30f2bb2c53 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-697d39aa-9085-46b4-b0a5-2c0f75bc0407-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Flow 'volume_create_manager' (55c89be8-103f-4bd9-903f-73bd47a682f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd46d727-f4e7-47ed-ac17-1ae1354503e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:10:00 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-quobyte-f6553c8f-c538-415a-bbb7-1af7dfe1f767" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd46d727-f4e7-47ed-ac17-1ae1354503e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-27T10:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612a0c03-a6cd-4dfc-8b95-f1def031b7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7069c50515954a1892f9fd85d1199772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-27T10:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ca15c7f-7176-4181-a4dc-4e9f3a023d3b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-27T10:10:00Z,use_quota=True,user_id='f22e410014d548b3b151793901d2b649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1865209-0d8a-427a-8846-eeab696e74bb),volume_type_id=b1865209-0d8a-427a-8846-eeab696e74bb)' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4519553-67b1-424b-86a2-0a89144ea9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4519553-67b1-424b-86a2-0a89144ea9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1146f43-f83f-46f5-87b5-917f3dd80845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1146f43-f83f-46f5-87b5-917f3dd80845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '612a0c03-a6cd-4dfc-8b95-f1def031b7b1', 'volume_name': 'volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1', 'volume_size': 1, 'snapshot_id': '4ca15c7f-7176-4181-a4dc-4e9f3a023d3b'}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9086f1cf-e9bd-446e-aefa-1afddefd0ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9086f1cf-e9bd-446e-aefa-1afddefd0ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec54694-44e4-46c3-9d23-ea96d7d9f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:10:00 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Volume 612a0c03-a6cd-4dfc-8b95-f1def031b7b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1', 'volume_size': 1, 'snapshot_id': '4ca15c7f-7176-4181-a4dc-4e9f3a023d3b'}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "cinder-quobyte-4ca15c7f-7176-4181-a4dc-4e9f3a023d3b-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" by "_create_volume_from_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-4ca15c7f-7176-4181-a4dc-4e9f3a023d3b-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Creating volume 612a0c03-a6cd-4dfc-8b95-f1def031b7b1 from snapshot 4ca15c7f-7176-4181-a4dc-4e9f3a023d3b {{(pid=84197) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Selected 10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8 as target Quobyte volume. {{(pid=84197) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "cinder-quobyte-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" by "_copy_volume_from_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-f6553c8f-c538-415a-bbb7-1af7dfe1f767" acquired by "delete_volume" :: waited 0.106s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[81602633-3b2b-4ee0-92ed-a8a1179bebba]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" acquired by "_copy_volume_from_snapshot" :: waited 0.155s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] snapshot: 4ca15c7f-7176-4181-a4dc-4e9f3a023d3b, volume: 612a0c03-a6cd-4dfc-8b95-f1def031b7b1,  {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d8df58-dc32-4b74-9b3a-968f26cd604c]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:00 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767" returned: 0 in 0.650s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-f6553c8f-c538-415a-bbb7-1af7dfe1f767" returned: 0 in 0.103s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-f6553c8f-c538-415a-bbb7-1af7dfe1f767" released by "delete_volume" :: held 0.943s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:01 devstack quobyte-client[84221]: System call of process 102492 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:10:01 devstack quobyte-client[84221]: System call of process 102492 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" returned: 0 in 0.625s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce9c9eff-0057-4408-9682-8680f4c00ae6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] will copy from snapshot at /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Creating direct copy from snapshot {{(pid=84197) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a38e9c-26b3-4a2e-9883-8f86606e57db]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:01 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created reservations ['62822eb2-9832-4512-90ac-dc216443a156', '680dffb3-c168-4810-9707-819544489cd1', '52e14f91-b7ca-4f2e-9cf9-b6b41b7556b4', '24bfc8a9-9f0a-49e2-910d-0251a3f357f4'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:10:02 devstack quobyte-client[84221]: System call of process 102498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6" returned: 0 in 0.625s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG cinder.utils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1 not found in is_blk_device check {{(pid=84197) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:02 devstack quobyte-client[84221]: System call of process 102502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:10:02 devstack quobyte-client[84221]: The server volume:55f6f18d-800b-4611-bcfd-6c008ff589eb@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=55f6f18d-800b-4611-bcfd-6c008ff589eb, inode=173, name=volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.135), requestorAccessMask=0
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-49a78e5a-da40-41fe-be7a-f1a8134fa34c-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.544s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:10:02 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-49a78e5a-da40-41fe-be7a-f1a8134fa34c-delete_volume" acquired by "delete_volume" :: waited 0.264s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:03 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Deleted volume successfully.
Sep 27 12:10:03 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-36bac3a3-b7f5-497d-bb2b-9faa8ffafa5a tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-f6553c8f-c538-415a-bbb7-1af7dfe1f767-delete_volume" released by "delete_volume" :: held 3.483s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:03 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:10:03 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-quobyte-49a78e5a-da40-41fe-be7a-f1a8134fa34c" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:03 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-49a78e5a-da40-41fe-be7a-f1a8134fa34c" acquired by "delete_volume" :: waited 0.087s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:03 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[105ea03b-bffb-4d66-bffd-ddf764498811]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:03 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:05 devstack quobyte-client[84221]: System call of process 102512 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:10:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c" returned: 0 in 1.596s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:05 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:06 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-49a78e5a-da40-41fe-be7a-f1a8134fa34c" returned: 0 in 0.559s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:06 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-49a78e5a-da40-41fe-be7a-f1a8134fa34c" released by "delete_volume" :: held 2.856s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:07 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created reservations ['4636b677-f963-421a-98ed-12c6d2b05291', 'cefdff01-c06b-4170-add3-1a82bc1fbd86', 'e1fd65ad-ede7-4008-9b4c-9858ca74d371', '124587a8-be5d-420a-bff9-8e4fc8640a3c'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:10:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:10:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:10:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:10:07 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:10:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:10:07 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" returned: 0 in 5.815s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.328s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:08 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:10:08 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[558191d9-6bb9-4d0f-9b29-25b5eb6ce8e3]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:08 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Deleted volume successfully.
Sep 27 12:10:08 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-f5ecabcc-416d-45c1-b9e6-3cd180c99474 tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-49a78e5a-da40-41fe-be7a-f1a8134fa34c-delete_volume" released by "delete_volume" :: held 5.790s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-98b75d6f-c932-42b0-80aa-29d18c3a9229-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:08 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-98b75d6f-c932-42b0-80aa-29d18c3a9229-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:09 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "cinder-quobyte-98b75d6f-c932-42b0-80aa-29d18c3a9229" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-98b75d6f-c932-42b0-80aa-29d18c3a9229" acquired by "delete_volume" :: waited 0.009s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[3823da9f-161e-4ec0-9ba8-97fa9f0e2d96]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-98b75d6f-c932-42b0-80aa-29d18c3a9229 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6" returned: 0 in 0.800s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG cinder.image.image_utils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Image conversion details: src /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1 {{(pid=84197) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 27 12:10:09 devstack cinder-volume[84197]: INFO cinder.image.image_utils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Converted 1024.00 MB image at 175.01 MB/s
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] File path /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1 is being set with permissions: 660 {{(pid=84197) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" returned: 0 in 0.106s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" released by "_copy_volume_from_snapshot" :: held 8.886s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-4ca15c7f-7176-4181-a4dc-4e9f3a023d3b-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" released by "_create_volume_from_snapshot" :: held 9.070s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.095s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:10:09 devstack quobyte-client[84221]: System call of process 102521 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-98b75d6f-c932-42b0-80aa-29d18c3a9229" returned: 0 in 0.692s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-98b75d6f-c932-42b0-80aa-29d18c3a9229 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec54694-44e4-46c3-9d23-ea96d7d9f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1', 'volume_size': 1, 'snapshot_id': '4ca15c7f-7176-4181-a4dc-4e9f3a023d3b'}' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:10:09 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233278f1-db15-4759-8ca8-b945195d7fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-98b75d6f-c932-42b0-80aa-29d18c3a9229" returned: 0 in 0.298s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:10 devstack cinder-volume[84197]: INFO cinder.volume.flows.manager.create_volume [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Volume volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1 (612a0c03-a6cd-4dfc-8b95-f1def031b7b1): created successfully
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233278f1-db15-4759-8ca8-b945195d7fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84197) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Flow 'volume_create_manager' (55c89be8-103f-4bd9-903f-73bd47a682f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84197) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-quobyte-98b75d6f-c932-42b0-80aa-29d18c3a9229" released by "delete_volume" :: held 1.096s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-ff94d255-af3a-4aaa-a996-b45eff6e9851 tempest-SnapshotDependencyTests-205885686 None] Created volume successfully.
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Created reservations ['c5bbf1bc-ee7f-4ff1-b6bb-3fbd8950c3af', '2330458e-616a-4b6a-ae0d-c059d4e6c390', 'f4e49cc8-49c9-4c38-b244-4f77293adadb', '88b1630f-5d0d-41db-9046-217997370693'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "cinder-4ca15c7f-7176-4181-a4dc-4e9f3a023d3b-delete_snapshot" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.297s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:10:10 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Deleted volume successfully.
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-4ca15c7f-7176-4181-a4dc-4e9f3a023d3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.225s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:10 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "cinder-quobyte-ce9c9eff-0057-4408-9682-8680f4c00ae6" by "delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-ce9c9eff-0057-4408-9682-8680f4c00ae6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "cinder-quobyte-4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" by "_delete_snapshot" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-60415d6d-1854-4d4e-a6ce-3aa4254a4bbe tempest-CreateVolumesFromSourceVolumeTest-466196054 None] Lock "cinder-98b75d6f-c932-42b0-80aa-29d18c3a9229-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Deleting offline snapshot 4ca15c7f-7176-4181-a4dc-4e9f3a023d3b of volume ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 27 12:10:10 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] snapshot_file for this snap is: volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b {{(pid=84197) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 27 12:10:11 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[025421fd-877b-469c-9374-f7ecb6f2dde1]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:11 devstack quobyte-client[84221]: System call of process 102531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:10:11 devstack quobyte-client[84221]: System call of process 102531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:10:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" returned: 0 in 0.473s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:11 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.remotefs [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce9c9eff-0057-4408-9682-8680f4c00ae6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84197) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 27 12:10:11 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[184d92cb-0f5a-4fc1-a9b8-fa0c67ec34ff]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:11 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6" returned: 0 in 0.460s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:12 devstack quobyte-client[84221]: System call of process 102540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 27 12:10:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" returned: 0 in 0.240s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:12 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6.4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" returned: 0 in 0.107s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-4ca15c7f-7176-4181-a4dc-4e9f3a023d3b" released by "_delete_snapshot" :: held 1.631s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:12 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-ce9c9eff-0057-4408-9682-8680f4c00ae6" released by "delete_snapshot" :: held 1.668s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:12 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Created reservations ['ec459053-5e92-450e-9013-79507edc0f15', '9c65aba3-0072-433c-b4a8-9c73b6ebef16', 'a21df420-e90b-4404-bd57-294c6d37716f', '9ffe1c94-1f8d-481a-bd00-b1d5f1b6fe6b'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:10:13 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Delete snapshot completed successfully.
Sep 27 12:10:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-61d3c2d9-b2f9-45b8-80d8-12605b1334f1 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-4ca15c7f-7176-4181-a4dc-4e9f3a023d3b-delete_snapshot" released by "delete_snapshot" :: held 2.161s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "cinder-ce9c9eff-0057-4408-9682-8680f4c00ae6-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-ce9c9eff-0057-4408-9682-8680f4c00ae6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:13 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:10:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "cinder-quobyte-ce9c9eff-0057-4408-9682-8680f4c00ae6" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:13 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-ce9c9eff-0057-4408-9682-8680f4c00ae6" acquired by "delete_volume" :: waited 0.012s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:13 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[967bdfa2-4d41-4625-b858-14336ea9dde3]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:13 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6" returned: 0 in 0.393s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:14 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-ce9c9eff-0057-4408-9682-8680f4c00ae6" returned: 0 in 0.115s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:14 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-ce9c9eff-0057-4408-9682-8680f4c00ae6" released by "delete_volume" :: held 0.683s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:14 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Created reservations ['7c3c4899-3a84-401d-b25e-c8d01c40dd54', '2bf5d903-52c7-4f59-a292-b42b59be7481', 'ee09de4a-5de1-4250-b441-5d20cad2c257', '55079bb2-b0f5-4dbf-93ec-df10b48dd0b7'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:10:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:10:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:10:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:10:15 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:10:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:10:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:15 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.112s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:15 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:10:15 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Deleted volume successfully.
Sep 27 12:10:15 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-c068a014-9388-4a08-a21f-a11002de76b7 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-ce9c9eff-0057-4408-9682-8680f4c00ae6-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "cinder-612a0c03-a6cd-4dfc-8b95-f1def031b7b1-delete_volume" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-612a0c03-a6cd-4dfc-8b95-f1def031b7b1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:16 devstack cinder-volume[84197]: WARNING cinder.volume.volume_utils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "cinder-quobyte-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" by "delete_volume" {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" acquired by "delete_volume" :: waited 0.011s {{(pid=84197) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa26d85-ac0c-466e-866c-e735069c0cbd]: (4, 'qcow2') {{(pid=85239) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" returned: 0 in 0.400s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] CMD "rm -f /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65/volume-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" returned: 0 in 0.103s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:16 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-quobyte-612a0c03-a6cd-4dfc-8b95-f1def031b7b1" released by "delete_volume" :: held 0.662s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG cinder.quota [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Created reservations ['16996d8e-21ac-4fb7-9245-3bd99b73f423', '1e224af6-4ae8-4bef-843b-0ed8b1484844', '4aab45f8-ce5d-4491-880b-98c80a6ad863', 'ea051309-bebb-4b76-b7e3-a5d0e1ec3939'] {{(pid=84197) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.108s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 27 12:10:17 devstack cinder-volume[84197]: INFO cinder.volume.manager [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Deleted volume successfully.
Sep 27 12:10:17 devstack cinder-volume[84197]: DEBUG cinder.coordination [None req-77e5f010-01a8-48a3-ab43-fa403aca82a5 tempest-SnapshotDependencyTests-205885686 None] Lock "cinder-612a0c03-a6cd-4dfc-8b95-f1def031b7b1-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=84197) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 27 12:10:27 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:SELECT=74,cinder:INSERT=25,cinder:UPDATE=110,cinder:DELETE=6 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:10:27 devstack cinder-volume[84197]: DEBUG dbcounter [-] [84197] Writing DB stats cinder:UPDATE=106,cinder:SELECT=66,cinder:INSERT=23,cinder:DELETE=13 {{(pid=84197) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 27 12:10:39 devstack cinder-volume[84197]: DEBUG oslo_service.periodic_task [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84197) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 27 12:10:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 27 12:10:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 27 12:10:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8': None} {{(pid=84197) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 27 12:10:39 devstack cinder-volume[84197]: DEBUG cinder.volume.drivers.quobyte [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Available shares ['10.10.41.181/cinder-vol-5f3a4e4a-c48a-415c-b2ce-05862ccbf9c8'] {{(pid=84197) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 27 12:10:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.lockutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84197) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 27 12:10:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65 {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 27 12:10:39 devstack cinder-volume[84197]: DEBUG oslo_concurrency.processutils [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/eb48913e054d66a3ee46b1a82ae72b65" returned: 0 in 0.118s {{(pid=84197) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 27 12:10:39 devstack cinder-volume[84197]: DEBUG cinder.manager [None req-c5018f9f-8314-445c-b98c-7315cbecdcdb None None] Notifying Schedulers of capabilities ... {{(pid=84197) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}